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1 PARALLEL CONCATENATED CODE WITH 

SOFT-IN SOFT-OUT INTERACTIVE TURBO DECODER 

FIELD OF THE INVENTION 
5 The invention relates to methods, apparatus, and signals used in channel 

coding and decoding, and, in particular embodiments to methods, apparatus and 
signals for use with turbo and turbo-trellis encoding and decoding for communication 
channels. 

10 BACKGROUND OF THE INVENTION 

A significant amount of interest has recently been paid to channel coding. For 
example a recent authoritative text states: 

"Channel coding refers to the class of signal transformations designed to improve 
communications performance by enabling the transmitted signals to better withstand 

15 the effects of various channel impairments, such as noise, interference, and fading. 
These signal-processing techniques can be thought of as vehicles for accomplishing 
desirable system trade-offs (e.g., error-performance versus bandwidth, power versus 
bandwidth). Why do you suppose channel coding has become such a popular way 
to bring about these beneficial effects? The use of large-scale integrated circuits 

20 (LSI) and high-speed digital signal processing (DSP) techniques have made it 
possible to provide as much as 10 dB performance improvement through these 
methods, at much less cost than through the use of most other methods such as 
higher power transmitters or larger antennas." 

From "Digital Communications" Fundamentals and Applications Second 

25 Edition by Bernard Sklar, page 305 © 2001 Prentice Hall PTR. 

Stated differently, improved coding techniques may provide systems that can 
operate at lower power or may be used to provide higher data rates. 
Conventions and Definitions: 

Particular aspects of the invention disclosed herein depend upon and are 

30 sensitive to the sequence and ordering of data. To improve the clarity of this 

disclosure the following convention is adopted. Usually, items are listed in the order 
that they appear. Items listed as #1 , #2, #3 are expected to appear in the order #1 , 
#2, #3 listed, in agreement with the way they are read, i.e. from left to right. 
However, in engineering drawings, it is common to show a sequence being 

35 presented to a block of circuitry, with the right most tuple representing the earliest 
sequence, as shown in Figure 2, where 207 is the earliest tuple, followed by tuple 

-1- 
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1 209. The IEEE Standard Dictionary of Electrical and Electronics Terms, Sixth 

Edition, defines tuple as a suffix meaning an ordered set of terms (sequence) as in 
N-tuple. A tuple as used herein is merely a grouping of bits having a relationship to 
each other. 

5 Herein, the convention is adopted that items, such as tuples will be written in 

the same convention as the drawings. That is in the order that they sequentially 
proceed in a circuit. For example, "Tuples 207 and 209 are accepted by block 109" 
means tuple 207 is accepted first and then 209 is accepted, as is seen in Figure 2. 
In other words the text will reflect the sequence implied by the drawings. Therefore 

10 a description of Figure 2 would say "tuples 207 and 209 are provided to block 109" 
meaning that tuple 207 is provided to block 109 before tuple 209 is provided to block 
109. 

Herein an interleaver is defined as a device having an input and an output. 
The input accepting data tuples and the output providing data tuples having the 

15 same component bits as the input tuples, except for order. 

An integral tuple (IT) interleaver is defined as an interleaver that reorders 
tuples that have been presented at the input, but does not separate the component 
bits of the input tuples. That is the tuples remain as integral units and adjacent bits 
in an input tuple will remain adjacent, even though the tuple has been relocated. 

20 The tuples, which are output from an IT interleaver are the same as the tuples input 
to interleaver, except for order. Hereinafter when the term interleaver is used, an IT 
interleaver will be meant. 

A separable tuple (ST) interleaver is defined as an interleaver that reorders 
the tuples input to it in the same manner as an IT interleaver, except that the bits in 

25 the input tuples are interleaved independently, so that bits that are adjacent to each 
other in an input tuple are interleaved separately and are interleaved into different 
output tuples. Each bit of an input tuple, when interleaved in an ST interleaver, will 
typically be found in a different tuple than the other bits of the input tuple from where 
it came. Although the input bits are interleaved separately in an ST interleaver, they 

30 are generally interleaved into the same position within the output tuple as they 

occupied within the input tuple. So for example, if an input tuple comprising two bits, 
a most significant bit and a least significant bit, is input into an ST interleaver the 
most significant bit will be interleaved into the most significant bit position in a first 
output tuple and the least significant bit will be interleaved into the least significant 

35 bit position in a second output tuple. 

Modulo-N sequence designation is a term meaning the modulo-N of the 
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1 position of an element in a sequence. If there are k item $® in a sequence then the 
items have ordinal numbers 0 to k-1, i.e. I 0 through l^ representing the position of 
each time in the sequence. The first item iri the sequence occupies position 0 t the 
second item in a sequence I, occupies position 1, the third item in the sequence l 2 

5 occupies position 2 and so forth up to item \ k . v which occupies the k'th or last 
position in the sequence. The modulo-N sequence designation is equal to the 
position of the item in the sequence modulo-N . For exampfe, the moduIo-2 
sequence designation of l 0 =0 t the modulo-2 sequence designation of ^=1, and the 
modulo-2 sequence designation of l 2 =0 and so forth. 

10 A modulo-N interleaver is defined as an interleaver wherein the interleaving 

function depends on the modulo-N value of the tuple input to the interleaver. 
Modulo interleaves are further defined and illustrated herein. 

A modulo-N encoding system is one that employs one or more modulo 
interleaves. 

15 

SUMMARY OF PREFERRED EMBODIMENTS OF THE INVENTION 

In one aspect of the invention a method for encoding an information signal is 
disclosed. The method includes nonsystematically encoding the information signal, 
interleaving the information signal to form an interleaved information signal and 

20 encoding the interleaved information signal. 

In another aspect of the invention a method for encoding an information signal 
is disclosed. The method includes encoding the information signal, interleaving the 
information signal to form an interleaved information signal; and nonsystematically 
encoding the interleaved information signal. 

25 In another aspect of the invention a method for encoding an information signal 

is disclosed. The method includes encoding the information signal, modulo-N 
interleaving the information signal (where N is an integer greater than one), and 
encoding the modulo interleaved information signal. 

In another aspect of the invention a method for parallel concatenated 

30 encoding an information signal is disclosed. The method includes turbo trellis 

encoding an information signal, mapping the encoded information signal in a first 
mapper; and concatenating the encoded signal mapped in the first mapper with 
another signal mapped in a second mapper. In another aspect of the invention a 
method for interleaving a first block of data tuples to create a second block of data 

35 tuples is disclosed. The method includes identifying a modulo sequence designation 
for each data tuple in the first block, and interleaving the data tuples from the first 
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block into positions in the second block having the same modulo sequence 
designation. 

In another aspect of the invention a method for encoding data tuples is 
disclosed. The method includes ST interleaving the data tuples in a first even-odd 
interleaves encoding in a first encoder the data tuples interleaved in the first 
interleaver ST interleaving the data tuples in a second even-odd interleaver, 
encoding in a second encoder the data tuples interleaved in the second interleaver 
and selecting encoded tuples alternatively from the first and second encoder. 

In another aspect of the invention a method for encoding data tuples is 
disclosed. The method includes encoding the data tuples in a first encoder, 
interleaving the data tuples in an even/odd interleaver, encoding the interleaved 
tuples in a second encoder and selecting encoded tuples alternatively from the first 
and second encoder. 

In another aspect of the invention a method of encoding data symbols is 
disclosed. The method includes dividing a data tuple into a sequential sequence of 
equally sized tuples of N input bits, the tuples being of size N regardless of the size 
of the data tuple and turbo trellis modulated encoding the equally sized tuples. 

In another aspect of the invention a method for producing a code from a 
sequence of tuples is disclosed. The method includes encoding the sequence of 
tuples in a first encoding, modulo interleaving the input tuples in at least one 
interleaving, encoding the modulo interleaved tuples in at least one encoding, 
selecting the encoded tuples sequentially from each encoding and mapping the 
selected tuples in at least one mapper. 

In another aspect of the invention a method for creating a parallel 
concatenated code having a higher rate than the constituent encodings is disclosed. 
The method includes TTCM encoding information tuples, mapping a first portion of 
the encoded information tuples in a first mapping, puncturing a second portion of the 
encoded tuples and substituting uncoded tuples, and mapping the uncoded tuples in 
a second mapping. 

In another aspect of the invention a method for selecting mappings in a TTCM 
encoder is disclosed. The method includes selecting non-Ungerboeck mappings, 
computing the average effective distance between code words in each mapping, and 
selecting the non-Ungerboeck mapping which has approximately the greatest 
effective distance between code words. 

In another aspect of the invention a method for generating a modulo-IM 
interleaving sequence is disclpsed. The method includes selecting a range of 
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1 addresses from 0 to M for a seed interleaving sequence, creating N interleaving 

sequences from the seed sequence, creating a first sequence by selecting elements 
sequentially from the N interleaving sequences, multiplying each element in the first 
sequence by N to create a second sequence, and adding the element position 

5 modulo-N to each element in the second sequence to generate the modulo-N 
interleaving sequence. 

In another aspect of the invention a method for communicating data is 
disclosed. The method includes modulo-N turbo-encoding the data, communicating 
the data across a channel and modulo-N decoding the data. 

10 In another aspect of the invention a method for creating a higher rate code 

from a lower rate encoder constituent encoder, The method includes turbo trellis 
code modulation modulo-N encoding an input sequence of tuples to produce an 
output sequence of tuples and puncturing the output sequence and substituting 
uncoded input sequence tuples for corresponding encoded output sequence tuples. 

15 In another aspect of the invention a method for selecting a constellation 

mapping for a Turbo-Trellis Encoder is disclosed. The method includes selecting 
non-Ungerboeck mappings, determining the effective minimum distance of code 
words in the non-Ungerboeck mappings and selecting the non-Ungerboeck 
mapping having code words with the largest effective average distance form each 

20 other. 

In another aspect of the invention a method encoding data tuples is disclosed. 
The method includes encoding the data tuples with a Reed-Solomon encoder and 
turbo trellis encoding the tuples encoded with the Reed-Solomon code. 

In another aspect of the invention an apparatus for encoding an information 
25 signals is disclosed. The apparatus includes a nonsystematic encoder that accepts 
an information signal, an interleaver that interleaves the information signal to form an 
interleaved information signal and an encoder that encodes the interleaved 
information signal. In another aspect of the invention an apparatus for 
encoding an information signal is disclosed. The apparatus includes an encoder that 
30 encodes the information signal, an interleaver that interleaves the information signal 
to form an interleaved information signal and a nonsystematic encoder that encodes 
the interleaved information signal. 

In another aspect of the invention an apparatus for encoding an information 
signal is disclosed. The apparatus includes an encoder that encodes the 
35 information signal, a modulo-N interleaver that encodes the information signal, 
where N is an integer greater than one and an encoder that encodes the modulo 
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1 interleaved information signal. 

In another aspect of the invention an apparatus for parallel concatenated 
encoding an information signal is disclosed. The apparatus includes a turbo trellis 
encoder that encodes an information signal, a first mapper that accepts the encoded 

5 information signal, a second mapper that accepts the encoded information signal, a 
selector that selects a first signal mapped in the first mapper and selects a second 
signal mapped in the second mapper and means for concatenating the encoded 
signal mapped in the first mapper with the signal mapped in a second mapper. 

In another aspect of the invention an apparatus for interleaving a first block of 

10 data tuples to create a second block of data tuples is disclosed. The apparatus 

includes means for identifying a modulo sequence designation for each data tuple in 
the first block and means for interleaving the data tuples from the first block into 
positions in the second block having the same modulo sequence designation. 
In another aspect of the invention an apparatus for encoding data tuples is 

15 disclosed. The apparatus includes an ST even-odd interleaver that accepts the data 
tuples to be encoded, an encoder that encodes tuples output from the ST even-odd 
interleaver, a second ST even-odd interleaver that accepts the data tuples to be 
encoded, a second encoder that encodes tuples output from the ST even-odd 
interleaver and a selector that selects encoded tuples alternatively from the first and 

20 second encoder. 

In another aspect of the invention an apparatus for encoding data tuples is 
disclosed. The apparatus includes a first encoder that encodes the data tuples, an 
odd-even interleaver that interleaves the data tuples, a second encoder that 
encodes the interleaved tuples and a selector that selects encoded tuples 

25 alternatively from the first and second encoders thereby providing a composite 
signal. 

In another aspect of the invention an apparatus for encoding data tuples is 
disclosed. The apparatus includes a divider that divides the data tuples into a 
sequential sequence of equally sized tuples of N input bits, the tuples being of size N 

30 regardless of the size of the data tuple and a turbo trellis modulator that encodes the 
equally sized tuples. 

In another aspect of the invention an apparatus that produces a code from a 
sequence of tuples is disclosed. The apparatus includes a first encoder that 
encodes the sequence of tuples in a first encoding, at least one modulo interleaver 

35 that interleaves the input tuples in at least one interleaving, at least one second 
encoder that encodes the modulo interleaved tuples in at least one encoding, a 
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1 selector that selects encoded tuples sequentially from each encoding and at least 
one mapper that maps the selected tuples. 

In another aspect of the invention an apparatus that creates a parallel 
concatenated code having a higher rate than the constituent encodings is disclosed. 

5 The apparatus includes a TTCM encoder that accepts information tuples, a mapper 
that maps a first portion of the encoded information tuples in a first mapping, 
puncturing means for puncturing a second portion of the encoded tuples and 
substituting uncoded tuples, and a mapper that maps the uncoded tuples in a 
second mapping. 

10 In another aspect of the invention an apparatus for communicating data is 

disclosed. The apparatus includes a modulo-N turbo-encoder that accepts the data 
to be communicated and produces encoded data to be communicated, means for 
communicating the encoded data to be communicated across a channel and a 
modulo-N decoder that accepts and decodes the encoded data received from the 

15 channel. 

In another aspect of the invention an apparatus for creating a higher rate code 
from a lower rate encoder constituent encoder is disclosed. The apparatus includes 
a turbo trellis code modulation modulo-N encoder that accepts an input sequence of 
tuples and produces an output sequence of tuples and means for puncturing the 

20 output sequence and substituting uncoded input sequence tuples for corresponding 
encoded output sequence tuples. 

In another aspect of the invention an apparatus that encodes data tuples is 
disclosed. The apparatus includes a Reed-Solomon encoder that encodes the data 
tuples and a turbo trellis encoder that accepts the tuples encoded with the Reed- 

25 Solomon encoder. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features, aspects, and advantages of the present invention which have 
been described in the above summary will be better understood with regard to the 
30 following description, appended claims, and accompanying drawings where: 

Figure 1 is a graphical illustration of an environment in which embodiments of 
the present invention may operate. 

Figure 2 is a block diagram of a portion of a signal encoder according to an 
embodiment of the invention. 
35 Figure 3 is a block diagram of a parallel concatenated (turbo) encoder, 

illustrating the difference between systematic and nonsystematic forms. 
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Figure 4 is a schematic diagram of a rate 2/3 "feed forward" convolutions 
nonsystematic encoder. 

Figure 5 is a schematic diagram of a rate 2/3 "recursive" convolutional 
nonsystematic encoder. 

Figure 6 is a trellis diagram of the convolutional encoder illustrated in Figure 5. 

Figure 7 is a block diagram of a turbo-trellis coded modulation (TTCM) 
encoder. 

Figure 8A is a block diagram of a TTCM encoder utilizing multiple interleavers. 
Figure 8B is a graphical illustration of the process of modulo interleaving. 
Figure 8C is a further graphical illustration of the process of modulo 
interleaving. 

Figure 9 is a block diagram of a TTCM encoder employing a tuple interleaves 

Figure 10 is a block diagram of a TTCM encoder employing a bit interleaves 

Figure 1 1A is a first portion of combination block diagram and graphical 
illustration of a rate 2/3 TTCM encoder employing a ST interieaver, according to an 
embodiment of the invention. 

Figure 1 1B is a second portion of combination block diagram and graphical 
illustration of a rate 2/3 TTCM encoder employing a ST interieaver, according to an 
embodiment of the invention. 

Figure 12 is a combination block diagram and graphical illustration of rate Vz 
parallel concatenated encoder (PCE) employing a modulo-N Interieaver. 

Figure 13 is a graphical illustration of the functioning of a modulo-4 ST 
interieaver, according to an embodiment of the invention. 

Figure 14A is a graphical illustration of the generation of interieaver sequences 
from a seed interleaving sequence. 

Figure 14B is a graphical illustration of a process by which modulo-2 and 
modulo-3 interleaving sequences may be generated. 

Figure 14C is a graphical illustration of a process by which a modulo-4 
interleaving sequence may be generated.. 

Figure 15 is a graphical illustration of trellis encoding. 

Figure 16 is a graphical illustration of Turbo Trellis Coded Modulation (TTCM) 
encoding. 

Figure 17 is a graphical illustration of a rate 2/3 TTCM encoder according to 
an embodiment of the invention. 

Figure 18A is a graphical illustration of a rate Vz TTCM encoder, with 
constituent 2/3 rate encoders, according to an embodiment of the invention. 
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1 Figure 18B is a graphical illustration of alternate configurations of the rate % 

TTCM encoder illustrated in Figure 18A. 

Figure 18C is a graphical illustration of alternate configurations of the rate !4 
TTCM encoder illustrated in Figure 18A. 
5 Figure 1 8D is a graphical illustration of alternate configurations of the rate V* 

TTCM encoder illustrated in Figure 18A. 

Figure 18E is a graphical illustration of alternate configurations of the rate 34 
TTCM encoder illustrated in Figure 18A. 

Figure 19 is a graphical illustration of a rate 3/4 TTCM encoder, with 
10 constituent 2/3 rate encoders, according to an embodiment of the invention. 

Figure 20A is a graphical illustration of a rate 5/6 TTCM encoder, with 
constituent 2/3 rate encoders, according to an embodiment of the invention. 

Figure 20B is a graphical illustration which represents an alternate encoding 
that will yield the same coding rate as Figure 20A. 
15 Figure 21 A is a graphical illustration of a rate 8/9 TTCM encoder, with 

constituent 2/3 rate encoders, according to an embodiment of the invention. 

Figure 21 B is a graphical illustration which represents an alternate encoding 
that will yield the same coding rate as Figure 21 A 

Figure 22 is a graphical illustration of map 0 according to an embodiment of 
20 the invention. 

Figure 23 is a graphical illustration of map 1 according to an embodiment of 
the invention. 

Figure 24 is a graphical illustration of map 2 according to an embodiment of 
the invention. 

25 Figure 25 is a graphical illustration of map 3 according to an embodiment of 

the invention. 

Figure 26 is a block diagram of a moduIo-2 (even/odd) TTCM decoder 
according to an embodiment of the invention. 

Figure 27 is a TTCM modulo-4 decoder according to an embodiment of the 
30 invention. 

Figure 28 is a graphical illustration of a modulo-N encoder/decoder system 
according to an embodiment of the invention. 

Figure 29 is a graphical illustration of the output of the TTCM encoder 
illustrated in Figure 17. 
35 Figure 30 is a graphical illustration of the tuple types produced by the TTCM 

encoder illustrated in Figure 18A. 
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Figure 31 is a graphical illustration illustrating the tuple types produced by the 
rate 3/4 encoders of Figure 1 9. 

Figure 32 is a graphical illustration of the tuple types produced by the rate 5/6 
encoder illustrated in Figure 20A. 

Figure 33 is a chart defining the types of outputs produced by the 8/9th 
encoder illustrated in Figure 21A. 

Figure 34 is a further graphical illustration of a portion of the decoder 
illustrated in Figure 26. 

Figure 35 is a graphical illustration of the process carried on within the metric 
calculator of the decoder. 

Figure 36 is a graphical illustration of the calculation of a Euclidean squared 
distance metric. 

Figure 37 is a representation of a portion of a trellis diagram as may be 
present in either SISO 2606 or SISO 2608. 

Figure 38 is a generalized illustration of a forward state metric alpha and a 
reverse state metric beta. 

Figure 39A is a block diagram folder illustrating the parallel SISO coupling 
illustrated in Figure 26. 

Figure 39B is a block diagram of a modulo-N type decoder. 

Figure 40 is a block diagram illustrating the workings of a SISO such as that 
illustrated at 3901 , 3957, 2606 or 2701. 

Figure 41 is a graphical representation of the processing of alpha values within 
a SISO such as illustrated at 3901, 4000 or 2606. 

Figure 42 is a graphical illustration of the alpha processing within the SISO 

4000. 

Figure 43 is a block diagram further illustrating the read-write architecture of 
the decoder as illustrated in Figure 2606. 

Figure 44 is a graphical illustration illustrating the generation of decoder 
sequences. 

Figure 45 is a graphical illustration of a decoder trellis according to an 
embodiment of the invention. 

Figure 46A is a graphical illustration of a method for applying the Min* 
operation to four different values. 

Figure 46B is a graphical illustration further illustrating the use of the Min* 
operation. 

Figure 47 is a graphical illustration of two methods of performing electronic 
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addition. 

Figure 48A is a block diagram in which a carry sum adder is added to a Min* 
circuit according to an embodiment of the invention. 

Figure 48B is a block diagram in which a carry sum adder is added to a Min* 
circuit according to an embodiment of the invention. 

Figure 49 is a graphical illustration of Min* calculation. 

Figure 50A is a graphical illustration of the computation of the log portion of 
the Min* operation assuming that A is positive, as well as negative. 

Figure SOB is a graphical illustration of the computation of the log portion of 
the Min* operation, a variation of Figure 50A assuming that A is positive, as well as 
negative. 

Figure 51 is a graphical illustration of a Min* circuit according to an 
embodiment of the invention. 

Figure 51 A is a graphical illustration of the table used by the log saturation 
block of Figure 51. 

Figure 51 B is a graphical illustration of a simplified version of the table of 
Figure 51A. 

Figure 52A is a graphical illustration and circuit diagram indicating a way in 
which alpha values within a SISO may be normalized. 

Figure 52B is a graphical illustration and circuit diagram indicating an alternate 
way in which alpha values within a SISO may be normalized. 

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

Figure 1 is a graphic illustration of an environment in which embodiments of 
the present invention may operate. The environment illustrated at 101 is an 
information distribution system, such as may be found in a cable television 
distribution system. 

In Figure 1 data is provided to the system from an information source 103. 
For purposes of illustration, the information source displayed in Figure 1 may be 
considered to be a cable television system head end which provides video data to 
end users. A formatter 105 accepts data from the information source 103. The data 
provided by information source 103 may comprise analog or digital signals such as 
(but not limited to) video signals, audio signals, and data signals. The formatter 
block 105 accepts the data from the information source and formats it into an 
appropriate form, such as message tuples, which are illustrated at 107. The 
formatted data is then provided to a channel encoder 109. Channel encoder 109 
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encodes that data provided to it. In some embodiments of the present invention, the 
channel encoder 1 09 may provide an encoding, with different goals depending on 
the particular implementation, for example to make the signal more robust, to reduce 
the error probability, to operate the system using less transmission power or to 
enable a more efficient decoding of the signal. Channel encoder 109 then provides 
the encoded data to a transmitter 111. The transmitter transmits the encoded data 
provided to it by the channel encoder 109, for example, using an antenna 113. The 
signal broadcast from antenna 113 is received by a relay satellite 115 and then 
rebroadcast to a receiving terrestrial antenna, such as earth station antenna 117. 
Earth station antenna 117 collects the satellite signal and provides the collected 
signal to a receiver 119. The receiver 119 will amplify and demodulate/detect the 
signal as appropriate and provide the detected signal to a decoder 121. Decoder 
121 will essentially, reverse the process of the channel encoder 109 and recreate 
the message tuples 123, which should represent a good estimate of the message 
tuples 107 that had been broadcast. The decoder 121 may use Forward Error 
Correction (FEC), in order to correct errors in the received signal. The tuples 123 
provided by the decoder are then provided to a formatting unit 125, which prepares 
the received message tuples for use by an information sink, such as the television 
display illustrated at 127. 

Figure 2 is a block diagram of a portion of a signal encoder according to an 
embodiment of the invention. In Figure 2 message tuples 107 are provided to 
channel encoder 109. Channel encoder 109 comprises a Reed-Solomon unit 201, 
which provides a first encoding of the message tuples 107. The output of the Reed- 
Solomon (RS) unit 201 which includes a RS encoder and may include an interleaver 
is then provided a turbo trellis-coded modulation (TTCM) encoder 208 . The output 
of the Reed-Solomon unit 201 is then provided to a turbo encoder 203, which 
applies a parallel concatenated (turbo) encoding to the input received from the 
Reed-Solomon unit 201, and further provides it to a mapper 205. In addition, some 
of the bits of the data output from the Reed-Solomon unit 201 may bypass the turbo 
encoder 203 entirely and be coupled directly into the mapper 205. Such data bits 
which bypasses the turbo encoder 203 are commonly referred to as uncoded bits. 
The uncoded bits are taken into account in the mapper 205 but are never actually 
encoded in the turbo encoder 203. In some embodiments of the invention there are 
no uncoded bits. In other embodiments of the invention there may be several 
uncoded bits depending on the data rate of the overall turbo trellis-coded modulation 
(TTCM) encoder desired. The output of the Reed-Solomon unit 201 may vary in 
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1 form depending on the overall rate desired from the TTCM encoder 208 . Turbo 
encoders, such as that illustrated at 203, may have a variety of forms and 
classifications. One of the classifications of encoders in general and turbo encoders 
in particular is illustrated in Figure 3. 

5 Figure 3 is a block diagram of a parallel concatenated encoder illustrating the 

difference between systematic and nonsystematic forms. In Figure 3 data is input 
into the circuit at 301 . Data is output from the parallel concatenated encoder (PCE) 
circuit 300 at 303. The data output 303 of the PCE illustrated at 300 may reach the 
output via three different paths. Input data tuples (groups of one or more bits) may 

10 be received at 301 and coupled directly to the data output 303 through selector 

mechanism 305 along the path labeled D. The data input may also be coupled into 
a first encoder 307 where it will be encoded and then coupled along the path 
through selector 305 and into data output 303. The data accepted into the PCE 
circuit at 301 may also be provided to an interleaver 309. Interleaver 309 rearranges 

15 the input sequence of the data accepted by the PCE circuit at 301 . In other words, 
the interleaver shuffles the order of the data so that the data out of the interleaver 
309 is not the same order as the data into the interleaver 309. The data out of the 
interleaver 309 is then provided to a second encoder 31 1. The second encoder 31 1 
encodes the data provided to it by the interleaver 309 and then provides the 

20 encoded data along path E 2 through the selector 305 into the data output 303. If the 
selector 305 selects the data from path D and E 1 and E* where D represents all of 
the input data tuple, then a systematic-type turbo encoding is performed. However, 
if the data selector selects only between path and E 2 , such that there is no direct 
path between the data input and data output, a nonsystematic turbo encoding is 

25 performed. In general the data input at 301 comprises input data tuples which are to 
be encoded. The data output at 303 comprises code words, which are the encoded 
representation of the input data tuples. In general, in a systematic type of encoding, 
the input tuples are used as part of the output code words to which they correspond. 
Within parallel concatenated encoders, such as that illustrated at 300, encoders 

30 such as the first encoder 307 and second encoder 31 1 are commonly referred to as 
component or constituent encoders because they provide encoding, which are used 
as components of the overall turbo encoding. The first encoder 307 and the second 
encoder 311 may also have a variety of forms and may be of a variety of types. For 
example, the first encoder 307 may be a block encoder or a convolutional-type 

35 encoder. Additionally, the second encoder 31 1 may also be a block or 

convolutional-type encoder. The first and second encoders themselves may also be 
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1 of systematic or nonsystematic form. The types of encoders may be mixed and 

matched so that, for example, the first encoder 307 may comprise a nonsystematic 
encoder and second encoder 311 may comprise a systematic-type encoder. 

Constituent encoders, such as first encoder 307 and second encoder 311 may 

5 have delays incorporated within them. The delays within the encoders may be 

multiple clock period delays so that the data input to the encoder is operated on for 
several encoder clock cycles before the corresponding encoding appears at the 
output of the encoder. 

One of the forms of a constituent encoder is illustrated in Figure 4. 

10 Figure 4 is a schematic diagram of a rate two-thirds feed forward 

nonsystematic convolutional encoder. The encoder illustrated at 400 in Figure 4 is a 
rate two-thirds because there are two inputs 401 and 403 and three outputs 405, 
407 and 409. Accordingly, for each input tuple comprising two input bits 401 and 
403, which are accepted by the encoder 400, the output is a code word having three 

15 bits 405, 407 and 409. Therefore, for each two bits input at inputs 401 and 403 

three bits are output at 405, 407 and 409. The encoder of Figure 4 comprises three 
delays 417, 419 and 421. Such delays may be formed from D-type flip flops or any 
other suitable delay or storage element. The rate two-thirds feed forward encoder of 
Figure 4 also comprises five modulo-2 adders 411, 413, 415, 423 and 425. Modulo- 

20 2 adders are adders in which the outputs of the modulo-2 adder is equal to the 

modulo-2 sum of the inputs. Delay elements 417, 419 and 421 are clocked by an 
encoder clock. Modulo-2 adders 41 1 , 413, 415, 423 and 425 are combinational 
circuits which are unclocked. In combinational circuits the output appears a time 
delay after the inputs are changed. This time delay is due to the propagation time of 

25 the signal within the combinational circuits {this delay is assumed as a near zero 
delay herein) and not due to any clocking mechanisms. In contrast, a delay unit, 
such as 417, will not change its output until it receives an appropriate clock signal. 
Therefore, for an input signal to propagate, for example from input 403 through 
modulo-2 adder 41 1 , through delay 417, through modulo-2 adder 413, through delay 

30 41 9 t through modulo-2 adder 415, through delay 421 in order to appear at output 
409, the encoder clock 427 must first clock the input signal from 403 through delay 
unit 417, then through delay unit 419, and finally through delay unit 421. Therefore, 
once an input signal appears at 403 three encoder clocks 427 in succession will be 
required for the resultant output 409, which is associated with that input at 403, to be 

35 seen at the output. 

The encoder of Figure 4 is a feed forward encoder. The signal is always fed 
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1 forward and at no point in the circuit is there a path to feed back a signal from an 
later stage to an earlier stage. As a consequence a feed forward encoder, such as 
that illustrated in Figure 4, is a finite impulse response (FIR) type of state machine. 
That is, for an impulse signal applied at the input, the output will eventually settle into 

5 a stable state. 

The encoder illustrated in Figure 4 may further be classified as a 
nonsystematic encoder because none of the inputs, that is "either 401 or 403, appear 
at the output of the encoder. That is outputs 405, 407 or 409 don't reproduce the 
inputs in an encoded output associated with that input. This can be inferred from the 

10 fact that output 407, 405 and 409 have no direct connection to inputs 401 or 403. 

Figure 5 is a schematic diagram of a rate two-thirds, recursive, convolutional 
nonsystematic encoder. The encoder of Figure 5 is similar to the encoder of 
Figure 4 in that both encoders are nonsystematic and convolutional. The encoder of 
Figure 5 is the same schematically as the encoder of Figure 4 with the addition of a 

15 third input at moduIo-2 adder 511 and a third input at modulo-2 adder 51 5. The third 
input for each of modulo-2 adders 51 1 and 51 5 is formed by an additional modulo-2 
adder 527. Modulo-2 adder 527 is formed in part by the output of delay 521 . 
Modulo-2 adder 527 receives an input from delay 521 which is provided to modulo-2 
adders 51 1 and 515. Accordingly the encoder of Figure 5 is recursive. In other 

20 words, the inputs of delays 517 and 521 are partially formed from outputs occurring 
later in the signal path and fed back to an earlier stage in the circuit. Recursive 
encoders may exhibit outputs that change when repeatedly clocked even when the 
inputs are held constant. The encoder of Figure 5 is a constituent encoder, and is 
used with an embodiment of the invention as will be described later. 

25 Figure 6 is a trellis diagram for the encoder illustrated in Figure 5. A trellis 

diagram is a shorthand method of defining the behavior of a finite state machine 
such as the basic constituent encoder illustrated in Figure 5. The state values in 
Figure 6 represent the state of the encoder. As can be seen from the trellis diagram 
in Figure 6, when the encoder of Figure 5 is in any single state, it may transition to 

30 any one of four different states. It may transition to four different states because 
there are two inputs to the encoder of Figure 5 resulting in four different possible 
input combinations which cause transitions. If there had been only one input to the 
encoder of Figure 5, for example, if inputs 501 and 503 were connected, then each 
state in the trellis diagram would have two possible transitions. As illustrated in the 

35 trellis diagram in Figure 6, if the encoder is in state 0, state 1, state 2 or state 3, the 
encoder may then transition into state 0, state 2, state 4 or state 6. However, if the 
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encoder is in state 4, state 5, state 6 or state 7, it may transition into state 1 , state 3, 
state 5 or state 7. 

Figure 7 is a block diagram of a turbo trellis-coded modulation (TTCM) 
encoder. In Figure 7 an input data sequence 701 is provided to an "odd" 
convolutional encoder 703 and an interleaver 705. The interleaver 705 interleaves 
the input data sequence 701 and then provides the resulting interleaved sequence to 
"even" convolutional encoder 707. Encoders 703 and 707 are termed "odd" and 
"even" respectively because encodings corresponding to odd input tuples (i.e. input 
tuple no. 1, 3, 5, etc.) are selected by selector 709 from encoder 703 and encodings 
corresponding to even input tuples (i.e. input tuple no. 0, 2, 4, etc.) are selected by 
selector 709 from encoder 707. The output of either the odd convolutional encoder 
703 or the even convolutional encoder 707 is selected by a selecting mechanism 
709 and then passed to a mapper 710. Figure 7 is a generalized diagram according 
to an embodiment of the invention which illustrates a general arrangement for a 
TTCM encoder. The odd convolutional encoder 703 receives the input data 
sequence and, in an embodiment of the invention, convolutionally, 
nonsystematically, encodes the input data sequence. Even convolutional encoder 
707 receives the same input data as the odd convolutional encoder, except that the 
interleaver 705 has rearranged the order of the data. The odd and even 
convolutional encoders may be the same encoders,.different encoders or even 
different types of encoders. For example, the odd convolutional encoder may be a 
nonsystematic encoder, whereas the even convolutional encoder may be a 
systematic encoder. In fact the convolutional encoders 703 and 707 may be 
replaced by block-type encoders such as Hamming encoders or other block-type 
encoders well known in the art. For the purposes of illustration, both constituent 
encoders 703 and 707 are depicted as nonsystematic, convolutional, recursive 
encoders as illustrated in Figure 5 . The select mechanism 709 selects, from 
convolutional encoder 703, outputs corresponding to odd tuples of the input data 
sequence 701. The select mechanism 709 selects, from convolutional encoder 707, 
outputs which correspond to even tuples of the input data sequence 701 . Select 
mechanism 709 alternates in selecting symbols from the odd convolutional encoder 
703 and the even convolutional encoder 707. The selector 709 provides the 
selected symbols to the mapper 710. The mapper 710 then maps the output of 
either the even convolutional encoder 707 or the odd convolutional coder 703 into a 
data constellation (not shown). In order to maintain a sequence made up of 
distance segments stemming from the even and odd input tuples, the selector 709 
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1 selects only encodings corresponding to even tuples of the input data sequence 701 
from one encoder (e.g. 703), and selects only encoding corresponding to odd tuples 
of the input data sequence from the other encoder (e.g. 707). This can be 
accomplished by synchronizing the selection of encoded tuples from the odd (703) 

5 and even (707) encoders, for example using a clock 711, and by using an odd/even 
interleaver 705 to maintain an even/odd ordering of input data tuples to the even 
encoder 707. The odd/even interleaver 705 will be described in detail later. 

The encoder illustrated in Figure 7 is a type which will be known herein as a 
turbo trellis-coded modulation (TTCM) encoder. The interleaver 705, odd 

10 convolutional encoder 703, even convolutional encoder 707 and selector form a 

turbo encoder, also known as a parallel concatenated encoder (PCE). The encoder 
is known as a parallel concatenated encoder because two codings are carried on in 
parallel. For the parallel encoding, in the Figure 7 example one coding takes place 
in the odd convolutional encoder 703, and the other takes place in the even 

15 convolutional encoder 707. An output is selected sequentially from each encoder 
and the outputs are concatenated to form the output data stream. The mapper 710 
shown in Figure 7 provides the trellis coded modulation (TCM) function. Hence, the 
addition of the mapper makes the encoder a turbo trellis-type encoder. As shown in 
Figure 7, the encoders may have any number of bits in the input data tuple. It is the 

20 topology that defines the encoder-type. 

The encoder of Figure 7 is an illustration of only one of the possible 
configurations that may form embodiments of the present invention. For example, 
more than one interleaver may be employed, as shown in Figure 8. 

Figure 8A is a block diagram of a TTCM encoder using multiple interleaves. 

25 Figure 8A illustrates an exemplary embodiment of the present invention utilizing N 
interleaves. 

The first interleaver 802 is called the null interleaver or interleaver 1 . 
Generally in embodiments of the invention the null interleaver will be as shown in 
Figure 8A, that is a straight through connection, i.e. a null interleaver. All 

30 interleaving in a system will be with respect to the null sequence produced by the 
null interleaver. In the case where the null interleaver is merely a straight through 
connection the null sequence out of the null interleaver will be the same as the input 
sequence. The concept of null interleaver is introduced as a matter of convenience, 
since embodiments of the invention may or may not have a first interleaver a 

35 convenient way to distinguish is to say "where the first interleaver is the null 

interleaver" when the first encoder receives input tuples directly and to say "where 
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1 the first interleaver is an ST interleaved, when an ST interleaver occupies a position 
proximal to a first encoder. 

In Figure 8A source input tuples 801 are provided to encoder 81 1 and to 
interleaves 802 through 803. There are N interleaves counting the null interleaver 

5 as interleaver No. 1 and N encoders present in the illustration in Figure 8A. Other 
embodiments may additionally add an ST interleaver as interleaver No. 1 to process 
input tuples 801 prior to providing them to encoder 811. 

Source tuples T 0l T, and T 2 are shown as three bit tuples for illustrative 
purposes. However, those skilled in the art will know that embodiments of the 

10 invention can be realized with a varying number of input bits in the tuples provided to 
the encoders. The number of input bits and rates of encoders 81 1 through 819 are 
implementation details and may be varied according to implementation needs 
without departing from scope and spirit of the invention. 

Interleaves 803 through 809 in Figure 8A each receive the same source data 

15 symbols 801 and produce interleaved sequences 827 through 833. Interleaved 
sequences 827 through 833 are further coupled into encoders 813 through 819. 
Select mechanism 821 selects an encoded output from encoders 811 through 819. 
Selector 821 selects from each encoder 81 1 through 819 in sequence so that one 
encoded tuple is selected from each encoder in one of every N+1 selections. That is 

20 the selection number 0 (encoded tuple f 0 ) is chosen from encoder 81 1 , the selection 
number 1 (encoded tuple is chosen from encoder 813 V 2 is chosen from encoder 
815, and so forth. The same selection sequence is then repeated by selector 821. 

In order not to miss any symbols, each interleaver is a modulo-type 
interleaver. To understand the meaning of the term modulo interleaver, one can 

25 consider the interleaver of Figure 7 as a modulo-2 interleaver. The interleaver of 
Figure 7 is considered a modulo-2 interleaver because input tuples provided to the 
interleaver during odd times (i.e. provided as input tuple 1,3,5 etc.) will be 
interleaved into odd time positions at the output of the interleaver (e.g. output tuple 
77, 105, 321 etc.) That is the first tuple provided by an odd/even interleaver may be 

30 the third, fifth, seventh, etc. tuple provided from the interleaver, but not the second, 
fourth, sixth, etc. The result of any modulo-2 operation will either be a 0 or a 1 , that 
is even or odd respectively, therefore the interleaver of Figure 7 is termed a 
modulo-2 or odd/even interleaver. In general, according to embodiments of the 
invention, the value of N for a modulo-N interleaving system is equal to the number 

35 of interleavers counting the Null interleaver as the first interleaver in the case where 
there is no actual first interleaver. The modulo interleaving system of Figure 8A is 
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1 modulo-N because there are N interleaves, including null interleaver 1 , interleaving 
system. The interleaves in a modulo interleaver system may interleave randomly, S 
randomly, using a block interleaver, or using any other mechanism for interleaving 
known in the art, with the additional restriction that input/output positional integrity be 

5 maintained. When a sequence of tuples is interleaved, the modulo position value of 
an output will be the same as the modulo positional value of the input tuple. The 
position of a tuple modulo-N is known as a sequence designation, modulo 
designation, or modulo sequence designation. For example, in a modulo-4 
interleaver the first tuple provided to the interleaver occupies position 0 of the input 

10 tuple stream. Because 0 modulo-4 is zero the modulo sequence designation of the 
first input tuple is 0 . The tuple occupying the position 0 may then be interleaved to 
a new output position #4, #8, #12, #16, etc., which also have the same modulo 
sequence designation, i.e. 0. The tuples occupying output position #4, #8, #12, #16 
all have a sequence designation of 0 because 4 mod 4 = 8 mod 4=12 mod 4=16 

15 mod 4 = 0. Similarly, the input tuple occupying position 2 and having sequence 

designation of 2 may be interleaved to a new output position #6, #10, #14, #20, etc, 
which also have the same modulo sequence designation of 2. The tuples in output 
positions #6, #10, #14, #20 etc have a modulo sequence designation of 2 because 6 
mod 4 = 10 mod 4 = 14 mod 4 = 20 mod 4 = 2. 

20 For example, in Figure 7 the modulo-2 interleaver 705, also known as an 

odd/even interleaver, may employ any type of interleaving scheme desired with the 
one caveat that the input data sequence is interleaved so that each odd sequence 
input to the interleaver is interleaved into another odd sequence at the output of the 
interleaver. Therefore, although interleaver 705 may be a random interleaver, it 

25 cannot interleave the inputs randomly to any output. It can, however, interleave any 
odd input to any random odd output and interleave any even input into any random 
even interleaved output. In embodiments of the present invention, a modulo 
interleaving system, such as that illustrated in Figure 8A, the interleaves must 
maintain the modulo positional integrity of interleaved tuples. For example, if there 

30 are 5 interleaves including the null interleaver (numbers 0-4) in Figure 8A, then 
Figure 8A would describe a modulo-5 interleaving system. In such a system, the 
input source data would be categorized by a modulo sequence number equal to the 
sequence position of the source data tuple modulo-5. Therefore, every input data 
tuple would have a sequence value assigned to it between 0 and 4 (modulo-5). In 

35 each of the 5 interleaves of the modulo-5 system, source data elements 

(characterized using modulo numbers) could be interleaved in any fashion, as long 
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as they were interleaved into an output data tuple having an output sequence 
modulo number designation equal to the input sequence modulo number 
designation. The terms modulo sequence number sequence designation, modulo 
position value modulo designation, modulo position all refer to the same modulo 
ordering. 

In other words an interleaver is a device that rearranges items in a sequence. 
The sequence is input in a certain order. An interleaver receives the items form the 
input sequence, I, in the order l 0 , l„ l 2 , etc., I„ being the first item received, I, being 
the second item received, item l 2 being the third item received. Performing a 
modulo-N operation on the subscript of I yields, the modulo-N position value of each 
input item. For example, if N=2 modulo-N position l 0 - Mod 2 (0) = 0 i.e. even, modulo- 
N position I, = Mod 2 (1) = 1 i.e., odd, modulo-N position l 2 = Mod 2 (2) = 0 i.e. even. 

Figure 8B is a graphical illustration of examples of modulo interleaving. 
Interleaving is a process by which input data tuples are mapped to output data 
tuples. 

Figure 8B illustrates of the process of modulo interleaving. As previously 
stated for the purposes of this disclosure an interleaver is defined as a device 
having one input and one output that receives a sequence of tuples and produces 
an output sequence having the same bit components as the input sequence except 
for order. That is, if the input sequence contains X bits having values of one, and Y 
bits having values of zero then the output sequence will also have X bits having 
values of 1 and Y bits having values of zero. An interleaver may reorder the input 
tuples or reorder the components of the input tuples or a combination of both. In 
embodiments of the invention the input and output tuples of an interleaver are 
assigned a modulo sequence designation which is the result of a modulo division of 
the input or output number of a tuple. That is, each input tuple is assigned a 
sequence identifier depending on the order in which it is accepted by the interleaver, 
and each output tuple is assigned a sequence identifier depending on the order in 
which it appears at the output of the interleaver. 

For example, in the case of a modulo-2 interleaver the sequence designation 
may be even and odd tuples as illustrated at 850 in Figure 8B. In such an example, 
the input tuple in the 0 position, indicating that it was the first tuple provided, is 
designated as an even tuple T„. Tuple T„ which is provided after tuple T„ is 
designated as an odd tuple, tuple T 2 , which is provided after T, is designated as an 
even tuple and so forth. The result of the modulo interleaving is illustrated at 852. 
The input tuples received in order T 0 , T„ T 2 , T 3 , T 5 , T 6 have been reordered to T 2 , T 3 , 
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1 T 6l T 5( T 0 , T 1f T 4 . Along with the reordered tuples at 852 is the new designation l 0 
through l 6 which illustrates the modulo sequence position of the interleaved tuples. 

The modulo-2 type interleaver illustrated in figure 8B at 854 can be any type of 
interleaves for example, a block interleaver, a shuffle interleaver or any other type of 

5 interleaver known in the art if it satisfies the additional constraint that input tuples are 
interleaved to positions in the output sequence that have the modulo position value. 
Therefore an input tuple having an even modulo sequence designation will always 
be interleaved to ah output tuple having an even modulo sequence designation and 
never will be interleaved to an output tuple having an odd modulo sequence 

10 designation. A modulo-3 interleaver 856 will function similarly to a modulo-2 

interleaver 854 except that the modulo sequence designation will not be even and 
odd but zero, one and two. The sequence designation is formed by taking the 
modulo-3 value of the input position (beginning with input position 0. Referring to 
Figure 8B modulo-3 interleaver 856 accepts input sequence T 0 , T 1t T 2l T 3t T 4 , T 5 and 

15 T 6 (858) and interleaves it to interleaved sequence 860: T 3 , T 4 , T 5t T 6 , T 1( T 2 which 
are also designated as interleaved tuples l 0 through l 6 . 

As a further illustration of modulo interleaving, a modulo-8 interleaver is 
illustrated at 862. The modulo 8 interleaver at 862 takes an input sequence 
illustrated at 864 and produces an output sequence illustrated at 866. The input 

20 sequence is given the modulo sequence designations of 0 through 7 which is the 

input tuple number modulo-8. Similarly, the interleaved sequence is given a modulo 
sequence designation equal to the interleaved tuple number modulo-8 and 
reordered compared to the input sequence under the constraint that the new position 
of each output tuple has the same modulo-8 sequence designation value as its 

25 corresponding input tuple. 

In summary, a modulo interleaver accepts a sequence of input tuples which 
has a modulo sequence designation equal to the input tuple number modulo-N 
where N = H of the interleaver counting the null interleaver. The modulo interleaver 
then produces an interleaved sequence which also has a sequence designation 

30 equal to the interleaved tuple number divided by the modulo of the interleaver. In a 
modulo interleaver bits which start out in an input tuple with a certain sequence 
designation must end up in an interleaved modulo designation in embodiments of 
the present invention. Each of the N interleaves in a modulo N interleaving system 
would provide for the permuting of tuples in a manner similar to the examples in 

35 Figure 86; however, each (interleaver would yield a different permutation. 

The input tuple of an interleaver, can have any number of bits including a 
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1 single bit. In the case where a single bit is designated as the input tuple, the modulo 
interieaver may be called a bit interleaves 

Inputs to interleaves may also be arbitrarily divided into tuples. For example, 
if 4 bits are input to in interieaver at a time then the 4 bits may be regarded as a 

5 single input tuple, two 2 bit input tuples or four 1 bit input tuples. For the purposes of 
clarity of the present application if 4 bits are input into an interieaver the 4 bits are 
generally considered to be a single input tuple of 4 bits. The 4 bits however may 
also be considered to be J4 of an 8 bit input tuple, two 2 bit input tuples or four 1 bit 
input tuples the principles described herein. If all input bits input to the interieaver 

10 are kept together and interleaved then the modulo interieaver is designated a tuple 
interieaver (a.k.a. integral tuple interieaver) because the input bits are interleaved as 
a single tuple. The input bits may be also interleaved as separate tuples. 
Additionally, a hybrid scheme may be implimented in which the input tuples are 
interleaved as tuples to their appropriate sequence positions, but additionally the bits 

15 of the input tuples are interleaved separately. This hybrid scheme has been 
designated as an ST interieaver. In an ST interieaver, input tuples with a given 
modulo sequence designation are still interleaved to interleaved tuples of similar 
sequence designations. Additionally, however, the individual bits of the input tuple 
may be separated and interleaved into different interleaved tuples (the interleaved 

20 tuples must all have the same modulo sequence designation as the input tuple from 
which the interleaved tuple bits were obtained). The concepts of a tuple modulo 
interieaver, a bit modulo interieaver, and a bit-tuple modulo interieaver are illustrated 
in the following drawings. 

Figure 9 is a block diagram of TTCM encoder employing a tuple type 

25 interieaver. In Figure 9 an exemplary input data sequence 901 comprises a 

sequence of data tuples T G) T 1f T 2 , T 3 and T 4 . The tuples are provided in an order 
such thatT 0 is provided first, T, is provided second, etc. Interieaver 915 interleaves 
data sequence 901 . The output of the interieaver comprises a new data sequence 
of the same input tuples but in different order. The data sequence 903, after 

30 interleaving, comprises the data tuples T 4 , T 3 , T 0 , T, and T 2 in that order. The tuple 
interieaver illustrated in Figure 9 at 915 is a modulo-2 or odd/even type interieaver. 
The original data sequence 901 is provided to odd convolutional encoder 905 and 
the interleaved data sequence 903 is provided to an even convolutional encoder 
907. A select mechanism 909 selects encoded outputs from the odd convolutional 

35 encoder 905 and the even convolutional encoder 907, according to the procedure 
provided below and illustrated in Figure 9, and provides the encoder output selected 
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1 to the mapper 911. The select mechanism 909 illustratively chooses encoded 

outputs from the "odd" convolutional encoder 905 that correspond to odd tuples in 
the input data sequence 901. The select device 909 also chooses encoded tuples 
from the even convolutional encoder 907, that correspond to the even tuples of input 

5 sequence 903. So if the odd convolutional encoder 905 produces encoded tuples 
O 0 , O tl 0 2 , 0 3 and 0 4 corresponding to the input sequence of data tuples 901 , the 
selector will select O t and 0 3 (which have an odd modulo sequence designation) to 
pass through the mapper. In like manner if the even convolutional encoder 
produces symbols E 4 , E 3 , E 0l E 1 and E 2 from the input sequence 903 and select 

10 mechanism 909 selects E 4 , E 0 and E 2 and passes those encoded tuples to the 

mapper 911. The mapper will then receive a composite data stream corresponding 
to encoded outputs E 4 , O,, E 0 , 0 3> and E 2 . In this manner an encoded version of 
each of the input data sequence tuples 901 is passed onto the mapper 911. 
Accordingly, all of the input data sequence tuples 901 are represented in encoded 

15 form in the data 913 which is passed onto the mapper 911 Although both encoders 
encode every input tuple, the encoded tuples having an odd sequence designation 
are selected from encoder 905 and the encoded tuples having an even sequence 
designation are selected from encoder 907. In the interleaver 915 of Figure 9, each 
tuple is maintained as an integral tuple and there is no dividing of the bits which form 

20 the tuple. A contrasting situation is illustrated in Figure 10. 

Figure 10 is a block diagram of a TTCM encoder employing a bit type 
interleaver. In Figure 10 an input tuple is represented at 1003 as input bits i 0 through 
i k . v The input bits i 0 through i,^ are coupled into an upper constituent encoder of 
1007. The input tuple 1003 is also coupled into interleaver 1005. The interleaver 

25 1005 is further divided into interleaves 1009, 1011 and 1013. Each of the 

interleaves 1 009, 1 01 1 and 1 013 accepts a single bit of the input tuple. The input 
tuple 1003 is then rearranged in the interleaver 1005 such that each bit occupies a 
new position in the sequence that is coupled into the lower constituent encoder 
1015. The interleaving performed by the interleaver 1005 may be any type of 

30 suitable interleaving. For example, the interleaver may be a block interleaver a 
modulo interleaver as previously described, or any other type of interleaver as 
known in the art. 

In the illustrated interleaver of Figure 10 the interleaving sequence provided by 
interleaver 1005, and hence by sub-interleavers 1009, 1011 and 1013, is 
35 independent of the positions of the bits within the input 1 003. Input tuple 1 001 

represents input bits which are not passed through either of the constituent encoders 
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1 1007 or 1015. The upper encoding 1017 comprises the uncoded input tuple 1001 
plus the encoded version of input tuple 1003, which has been encoded in the upper 
constituent encoder 1007. The lower encoding 1019 comprises the uncoded input 
tuple 1001 plus the output of the lower constituent encoder 1015 which accepts the 

5 interleaved version of input tuple 1003. A selector 1021 accepts either the upper or 
lower encoding and passes selected encoding to a symbol mapper 1023. 

Figure 1 1 A is a first part of a combination block diagram and graphic 
illustration of a rate 2/3 TTCM encoder employing a ST interleaver according to an 
embodiment of the invention. Figure 1 1 A and 1 1 B in combination illustrate a 

10 modulo-2 ST interleaver as may be used with a rate 2/3 TTCM encoder. In Figure 
1 1A input tuples 1 101 are provided to a rate 2/3 encoder 1 103. The rate 2/3 
encoder 1103 is designated as an even encoder because, although it will encode 
every input tuple, only the tuples corresponding to encoded even tuples will be 
selected from encoder 1 1 03 by the selection circuit. Input tuples comprise 2 bits, a 

15 most significant bit designated by an M designation and a least significant bit 

designated by an L designation. The first tuple that will be accepted by the rate 2/3 
even encoder 1 1 03 will be the even tuple 1 1 05. The even input tuple 1 1 05 
comprises 2 bits where M 0 is the most significant bit, and Lq is the least significant 
bit. The second tuple to be accepted by the rate 2/3 even encoder 1 103 is the 1 107 

20 tuple. The 1 107 tuple is designated as an odd tuple and comprises a most 

significant bit and a least significant bit L v The input tuples are designated even 
and odd because the interleaver 1 109, which is being illustrated in Figure 1 1A, is 
modulo-2 interleaver also known as an even/odd interleaver. The same principles, 
however, apply to any modulo-N interleaver. If the modulo interleaver had been a 

25 mod 3 interleaver instead of a mod 2 interleaver then the input tuples would have 
sequence designations 0, 1 and 2. If the modulo interleaver had been a modulo-4 
interleaver then the input tuples would have modulo sequence designations 0,1,2, 
3. The modulo interleaving scheme, discussed here with respect to modulo-2 
interleaves and 2 bit tuples, may be used with any size of input tuple as well as any 

30 modulo-N interleaver. Additionally, any rate encoder 1 103 and any type encoder 
may be used with the modulo ST interleaving scheme to be described. A rate 2/3 
encoder, a modulo-2 ST interleaver, and 2 bit input tuples have been chosen for 
ease of illustration but are not intended to limit embodiments of the invention to the 
form disclosed. In other words, the following modulo-2 ST interleaver is chosen 

35 along with 2 bit input tuples and a rate 2/3 encoder system in order to provide for a 
relatively uncluttered illustration of the principles involved. The ST interleaver 1 109 
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1 in this case actually can be conceptualized as two separate bit type interleaves 
1111 and 1113. The separation of the interleaves is done for conceptual type 
purposes in order to make the illustration of the concepts disclosed easier to follow. 
In an actual implementation the interleaver 1 109 may be implimented in a single 

5 circuit or multiple circuits depending on the needs of that particular implementation. 
Interleaver 1111 accepts the least significant bits of the input tuple pairs 1101. Note 
input tuple pairs designate input tuples having a pair, i.e. MSB and LSB, of bits. The 
interleaver 1111 interleaves the least significant bits of the input tuple pairs 1 101 and 
provides an interleaved sequence of least significant bits of the input tuple pairs for 

10 example those illustrated in 1 1 15. In the example, only eight input tuple pairs are 
depicted for illustration purposes. In an actual implementation the number of tuple 
pairs in a block to be interleaved could number tens of thousands or even more. 
Eight input tuple pairs are used for ease of illustration purposes. The least 
significant bits of the input tuple pairs 1 1 01 are accepted by the interleaver 1111 in 

15 the order Lq. L 1( L 2i L 3t L 4 , L 5l Le, and L 7 . The interleaver, in the example of Figure 
1 1A, then provides an interleaved sequence 1 1 15 in which the least significant bits 
of the input tuples have been arranged in the order L 6l Lg, L 4 , L 1f L 7 , L 0 and L 3 . 
Note that although the least significant bit of the input tuple pairs have been shuffled 
by the interleaver 1111 each least significant bit in an even tuple in the input tuple 

20 pairs is interleaved to an even interleaved position in the output sequence 1115. In 
like manner, odd least significant bits in the input sequence 1 101 are interleaved by 
interleaver 1111 into odd position in the output sequence 1115. This is also a 
characteristic of modulo ST interleaving. That is although the data input is 
interleaved, and the interleaving may be done by a variety of different interleaving 

25 schemes know in the art, the interleaving scheme, however, is modified such that 
even data elements are interleaved to even data elements and odd data elements 
are interleaved to odd data elements. In general, in modulo-N interleaves the data 
input to an interleaver would be interleaved to output positions having the same 
modulo sequence designation as the corresponding modulo sequence designation 

30 in the input sequence. That is, in a modulo-4 interleaver an input data element 
residing in a input tuple with a modulo sequence designation of 3 would end up 
residing in an interleaved output sequence with a modulo sequence designation of 3. 
In other words, no matter what type of interleaving scheme the interleaver (such as 
1111) uses, the modulo sequence designation of each bit of the input data tuples 

35 sequence is maintained in the output sequence. That is, although the positions of 
the input sequence tuples are changed the modulo interleaved positions are 
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1 maintained throughout the process. This modulo sequence designation, here even 
and odd because a modulo-2 interleaver is being illustrated, will be used by the 
selection mechanism to select encoded tuples corresponding to the modulo 
sequence designation of the input tuples. In other words, the modulo sequence 

S designation is maintained both through the interleaves and through the encoders. 
Of course, since the input tuples are encoded the encoded representation of the 
tuples appearing at the output of the encoder may be completely different and may 
have more bits than the input tuples accepted by the encoder. 

Similarly, the most significant bits of input tuples 1 101 are interleaved in 

10 interleaver 1113. In the example of Figure 1 1A, the sequence M 0 through M 7 is 
interleaved into an output sequence M 2 , M 7 , M 0 , M 5 , M 6 , M 3f M 4 , and M,. The 
interleaved sequence 1117, produced by interleaving the most significant bits of the 
input tuples 1 101 in interleaver 1113, along with the interleaved sequence of least 
significant bits 1 1 1 5 is provided to into the "odd" rate 2/3 encoder 1119. Note that in 

15 both cases all data bits are interleaved into new positions which have the same 

modulo sequence designation as the corresponding input tuples modulo sequence 
designation. 

Figure 1 1 B is a second part of a combination block diagram and graphic 
illustration of a rate 2/3 TTCM encoder employing an ST interleaver. In Figure 1 1 B 

20 the even rate 2/3 encoder 1 1 03 and the odd rate 2/3 encoder 1 1 1 9, as well as the 
tuples input to the encoders, are reproduced for clarity. Even encoder 1 103 accepts 
the input tuple sequence 1101. The odd encoder 1119 accepts an input sequence 
of tuples, which is formed from the interleaved sequence of most significant bits 
1117 combined with the interleaved sequence of least significant bits 1115. Both 

25 encoders 1 1 03 and 1 1 1 9 are illustrated as rate 2/3 nonsystematic convolutional 

encoders and therefore each have a 3 bit output. Encoder 1119 produces an output 
sequence 1 153. Encoder 1 1 03 produces an output sequence 1151. Both 
sequences 1151 and 1153 are shown in script form in order to indicate that they are 
encoded sequences. Both rate 2/3 encoders accept 2 bit input tuples and produce 

30 3 bit output tuples. The encoded sequences of Figure 1 1 B may appear to have 2 bit 
elements, but in fact the two letter designation and comprise 3 encoded bits each. 
Therefore, output tuple 1 155 which is part of sequence 1 153 is a 3 bit tuple. The 3 
bit tuple 1 155 however, is designated by a script M 7 and a script^ indicating that 
that output tuple corresponds to an input tuple 1 160, which is formed from most 

35 significant bit M 7 and least significant bit L5. In like manner, output tuple 1 157 of 

sequence 1151 comprises 3 bits. The designation of output tuple 1157 as// 0 andi? 0 
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1 indicates that that output tuple corresponds to the input tuple 1101, which is 
composed of input most significant bit M 0 and input least significant brt L^. It is 
worthwhile to note that output tuple of encoder 1 103, which corresponds to input 
tuple 1 161 maintains the same even designation as input tuple 1 161. In other 

5 words, the output tuple of an encoder in a modulo interleaving system maintains the 
same modulo sequence designation as the input tuple to which it corresponds. 
Additionally, in a ST interleaver input tuple bits are interleaved independently but are 
always interleaved to tuples having the same modulo sequence designation. 
Selector mechanism 1 163 selects between sequences 1 1 53 and 1 1 51 . 

10 Selector 1 163 selects tuples corresponding to an even modulo sequence 

designation from the sequence 1 151 and selects tuples corresponding to an odd 
modulo sequence designation from sequence 1 153. The output sequence created 
by such a selection process is shown at 1 165. This output sequence is then coupled 
into mapper 1 167. The modulo sequence 1165 corresponds to encoded tuples with 

15 an even modulo sequence designation selected from sequence 1 151 and encoded 
tuples with an odd modulo sequence designation selected from 1 153. The even 
tuples selected are tuple M 0 I 0 , tuple M 2 1 2% tuple M,l 4 and tuple M 6 £ 6 . Output 
sequence also comprises output tuples corresponding to odd modulo sequence 
designation^^, \up\eM 5 l n iuQ\eM 3 £ 7 and tuples and^ 

20 A feature of modulo tuple interleaving systems, as well as a modulo ST 

interleaving systems is that encoded versions of all the input tuple bits appear in an 
output tuple stream. This is illustrated in output sequence 1 165, which contains 
encoded versions of every bit of every tuple provided in the input tuple sequence 
1101. 

25 Those skilled in the art will realize that the scheme disclosed with respect to 

Figures 1 1A and 1 1 B can be easily extended to a number of interleaves as shown 
in Figure 8A. In such a case, multiple modulo interleaves may be used. Such 
interleaves may be modulo tuple interleavers in which the tuples that will be coupled 
to the encodes are interleaved as tuples or the interleaves may be ST interleavers 

30 wherein the input tuples are interleaved to the same modulo sequence designation 
in the output tuples but the bits are interleaved separately so that the output tuples 
of the interleavers will correspond to different bits than the input sequence. By 
interleaving tuples and bits within tuples a more effective interleaving may be 
obtained because both bits and tuples are interleaved. Additionally, the system 

35 illustrated in Figures 1 1 A and 1 1 B comprise an encoder 1 1 03 which accepts the 

sequence of input tuples 1101. The configuration of Figure 1 1 A and 1 1 B illustrates 
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1 one embodiment. In a second embodiment the input tuples are ST interleaved 
before being provided to either encoder. In this way both the even and odd 
encoders can receive tuples which have had their component bits interleaved, thus 
forming an interleaving which may be more effective. In such a manner, an even 

5 encoder may produce a code which also benefits from IT or ST tuple interleaving. 
Therefore, in a second illustrative embodiment of the invention the input tuples are 
modulo interleaved before being passed to either encoder. The modulo interleaving 
may be a tuple interleaving, or a ST interleaving. Additionally, the types of 
interleaving can be mixed and matched. 

10 Additionally, the selection of even and odd encoders is arbitrary and although 

the even encoder is shown as receiving uninterleaved tuples, it would be equivalent 
to switch encoders and have the odd encoder receive uninterleaved tuples. 
Additionally, as previously mentioned the tuples provided to both encoders may be 
interleaved. 

15 Figure 12 is a combination block diagram and graphical illustration of a rate 14 

parallel concatenated encoder (PCE) employing a modulo-N interleaves Figure 12 
is provided for further illustration of the concept of modulo interleaving. Figure 12 is 
an illustration of a parallel concatenated encoder with rate 14 constituent encoders 
1207 and 1209. The input tuples to the encoder 1201 are provided to rate 14 

20 encoder 1207. Each input tuple, for example, T 0 , T 1f T 2 and T n given an input tuple 
number corresponding to the order in which it is provided to the encoder 1207 and 
interleaver 121 1 . The input tuple number corresponds to the subscript of the input 
tuple. For example, T 0 the zero tuple is the first tuple provided to the rate Vz encoder 
1207, T 1 is the second tuple provided to the rate Vz encoder 1207, T 2 is the third 

25 tuple provided to the rate Vz input encoder 1207 and T n is the N plus first tuple 

provided to the rate Vz encoder 1207. The input tuples may be a single bit in which 
case the output of the rate 14 encoder 1207 would comprise 2 bits. The input tuples 
may also comprise any number of input bits depending on the number of inputs to 
the rate 14 encoder 1207. The modulo concept illustrated is identical where the rate 

30 Vz encoder is provided with tuples having a single bit or multiple bits. The input 
tuples 1201 are assigned a modulo sequence designation 1205. The modulo 
sequence designation is formed by taking the input tuple number modulo-N, which is 
the modulo order of the interleaver. In the example illustrated, the modulo order of 
the interleaver 1211 is N. Because the modulo order of the interleaver is N the 

35 modulo sequence designation can be any integer value between 0 and N-1. 

Therefore, the T 0 tuple has a modulo sequence designation of 0, the T t tuple has a 
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1 modulo sequence designation of 1 , the input tuple has a modulo sequence 

designation of N-1 , the T n input tuple has a modulo sequence designation of 0 and 
the T^ input tuple has a modulo sequence designation of 1 and so forth. 
Interleaver 121 1 produces interleaved tuples 1215. Similarly to the input tuples the 

5 interleaved tuples are given a modulo sequence designation which is the same 

modulo order as the interleaver 1211. Therefore, if the input tuples have a modulo 
sequence designation from 0 to N-1 then the interleaved tuples will have a modulo 
sequence designation of 0 to N-1 . The interleaver 1211 can interleave according to 
a number of interleaving schemes known in the art. In order to be a modulo 

10 interleaver, however, each of the interleaving schemes must be modified so that 
input tuples with a particular modulo sequence designation are interleaved to 
interleaved tuples with the same modulo sequence designation. The interleaved 
tuples are then provided to a second rate % encoder 1209. The encoder 1207 
encodes the input tuples, the encoder 1209 encodes the interleaved tuples and 

15 selector 1219 selects between the output of the encoder 1207 and the output of 

encoder 1209. It should be obvious from the foregoing description that modulo type 
interleaving can be carried cut using any modulo sequence designation up to the 
size of the interleaver. A modulo-2 interleaver is typically referred to herein as an 
odd/even interleaver as the modulo sequence designation can have only the values 

20 of 1 or 0, i.e., odd or even respectively. 

Figure 13 is a graphic illustration of the functioning of a modulo-4 ST 
interleaver according to an embodiment of the invention. In the illustrated example, 
the modulo-4 ST interleaver 1 301 interleaves a block of 60 tuples. That is the 
interleaver can accommodate 60 input tuples and perform and interleaving on them. 

25 Input tuples 24 through 35 are illustrated at 1303, to demonstrate an exemplary 

interleaving. Interleaved tuples 0-59 are illustrated at 1305. Input tuples 24 through 
35 are illustrated at 1303 as 2 bit tuples. Input tuple 24 includes bit boo which is the 
LSB or least significant bit of input tuple 24 and b 01 the MSB or most significant bit of 
input tuple 24. Similarly, input tuple 25 includes bos which is the least significant bit 

30 (LSB) of tuple 25 and b^ which is the most significant bit of input tuple 25. Each 
input tuple 1303 is assigned a modulo sequence designation which is equal to the 
tuple number modulo-4. The modulo sequence designation of tuple 24 is 0, the 
modulo sequence designation of tuple 25 is 1, the modulo sequence designation of 
tuple 26 is 2, the modulo sequence designation of tuple 27 is 3, the modulo 

35 sequence designation of tuple 28 is 0 and so forth. Because 1301 is a ST 

interleaver, the bits of each tuple are interleaved separately. Although the bits of 
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1 each tuple are interleaved separately, they are interleaved into an interleaved tuple 
having the same modulo sequence designation, i.e. tuple number mod 4 in the 
interleaved tuple as in the corresponding input tuple. Accordingly, bit b^the LSB of 
tuple 24 is interleaved to interleaved tuple number 4 in the least significant bit 

5 position. b 01 the MSB of input tuple 24 is interleaved to interleaved tuple 44 in the 
most significant bit position. Note that the modulo sequence designation of input 
tuple 24 is a 0 and modulo sequence designation of interleaved tuple 4 and 
interleaved tuple 44 are both 0. Accordingly, the criteria that bits of an input tuple 
having a given modulo sequence designation are interleaved to interleave positions 

10 having the same modulo sequence designation. Similarly, b^ and b„3 of input tuple 
25 are interleaved to interleaved tuple 57 and interleaved tuple 37 respectively. B M 
and b 05 of input tuple 26 are interleaved to interleaved tuples 2 and 22. In like 
manner the MSB and LSB of all illustrated input tuples 24 through 35 are interleaved 
to corresponding interleaved tuples having the same modulo sequence designation, 

1 5 as illustrated in Figure 1 3. 

Figure 14A is a graphical illustration of a method for generating an interleaving 
sequence from a seed interleaving sequence. Interleavers may be implimented in 
random access memory (RAM). In order to interleave an input sequence, an 
interleaving sequence may be used. Because interleavers can be quite large, it may 

20 be desirable that an interleaving sequence occupy as little storage space within a 
system as feasible. Therefore, it can be advantageous to generate larger 
interleaving sequences from smaller, i.e. seed interleaving sequences. Figure 14A 
is a portion of a graphical illustration in which a seed interleaving sequence is used 
to generate four interleaving sequences each the size of the initial seed interleaving 

25 sequence. In order to illustrate the generation of sequences from the seed 

interleaving sequence, an interleaving matrix such as that 1401 may be employed. 
The interleaving matrix 1401 matches input positions with corresponding output 
positions. In the interleaving matrix 1401 the input positions l„ through l s are listed 
sequentially. I 0 is the first interleaving element to enter the interleaving matrix 1401 . 

30 I, is the second element, etc. As will be appreciated by those skilled in the art, the 
input elements l„ through l 5 may be considered to be individual bits or tuples. The 
input positions in the interleaving matrix 1401 are then matched with the seed 
sequence. By reading through the interleaving matrix 1401 an input position is 
matched with a corresponding output position. In the illustrative example, of the 

35 interleaving matrix 1 401 , input l 0 is matched with the number 3 of the seed 

sequence. This means that the l„ or first element into the interleaving matrix 1401 
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1 occupies position 3 in the resulting first sequence. Similarly, l n will be matched with 
a 0 position in sequence 1 and so forth. In other words, the input sequence l 0l l lf l 2( 
l 3) l 4l l 5 is reordered according to the seed sequence so that the resulting sequence 
output from the interleaving matrix 1401 is l 1t l 2) l 5 , l 0 , l 4 , l 3 where the output 

S sequence is obtained by listing the sequence of the output in the usual ascending 
order l 0l l 1t l 2 , l 3 , I 4 , l 5l where the left most position is the earliest. Put another way, 
the resulting sequence number 1 is {3, 4, 0, 5, 2, 1}, which corresponds to the 
subscript of the output sequence 1409. Similarly, in interleaving matrix 1403 also 
called the inverse interleaving matrix or INTLV 1 the input sequence 1400 is 

10 accepted by the interleaving matrix 1403 but instead of being written into this 
interleaving matrix sequentially, as in the case with interleaving matrix 1401, the 
elements are written into the interleaving matrix according to the seed sequence. 
The interleaving matrix 1403 is known as the inverse of interleaving matrix 1401 
because by applying interleaving matrix 1401 and then successively applying inverse 

15 interleaving matrix 1403 to any input sequence, the original sequence is recreated. 
In other words, the two columns of the interleaving matrix 1401 are swapped in order 
to get interleaving matrix 1403. Resulting output sequence 1411 is l 3I l 0 , l 1( l 5 , l 4 , l 2 . 
Therefore, sequence number 2 is equal to 2, 4, 5, 1, 0, 3. 

The seed interleaving sequence can also be used to create an additional two 

20 sequences. The interleaving matrix 1405 is similar to interleaving matrix 1401 

except that the time reversal of the seed sequence is used to map the corresponding 
output position. The output then of interleaver reverse (INTLVR 1405) is then l 4 , l 3t 
l 0 » k> 'i» '2- Therefore, sequence 3 is equal to 2, 1, 5, 0, 3, 4. Next an 

interleaving matrix 1407 which is similar to interleaving matrix 1403 is used. 

25 Interleaving matrix 1407 has the same input position elements as interleaving matrix 
1403, however, except that the time reversal of the inverse of the seed sequence is 
used forthe corresponding output position within interleaving matrix 1407. In such a 
manner, the input sequence 1400 is reordered to 1 2 , l 4 , l 5 , l 1f l 0 , l 3 . Therefore, 
sequence number 4 is equal to 3, 0, 1 , 5, 4, 2, which are, as previously, the 

30 subscripts of the outputs produced. Sequences 1 through 4 have been generated 
from the seed interleaving sequence. In one embodiment of the invention the seed 
interleaving sequence is an S random sequence as described by S. Dolinar and D. 
Divsalar in their paper "Weight Distributions for Turbo Codes Using Random and 
Non-Random Permeations," TDA progress report 42-121, JPL, August 1995. 

35 Figure 14B is a series of tables illustrating the construction of various modulo 

interleaving sequences from sequence 1 through 4 (as illustrated in Figure 14A). 
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1 Table 1 illustrates the first step in creating an interleaving sequence of modulo-2, 
that is an even/odd interleaving sequence, from sequence 1 and 2 as illustrated in 
Figure 14A. Sequence 1 is illustrated in row 1 of table 1. Sequence 2 is illustrated 
in row 2 of table 1. Sequence 1 and sequence 2 are then combined in row 3 of table 

5 1 and are labeled sequence 1-2. In sequence 1-2 elements are selected 

alternatively, i.e. sequentially from sequence 1 and 2 in order to create sequence 1- 
2. That is element 1 , which is a 1 f is selected from sequence 1 and placed as 
element 1 in sequence 1-2. The first element in sequence 2, which is a 3, is next 
selected and placed as the second element in sequence 1-2. The next element of 

10 sequence 1-2 is selected from sequence 1 , the next element is selected from 
sequence 2, etc. Once sequence 1-2 has been generated, the position of each 
element in sequence 1-2 is labeled. The position of elements in sequence 1-2 is 
labeled in row 1 of table 2. The next step in generating the interleaving sequence, 
which will be sequence 5 is to multiply each of the elements in sequence 1-2 by the 

IS modulo of the sequence being created. In this case, we are creating a modulo-2 
sequence and therefore, each of the elements in sequence 1-2 will be multiplied by 
2. If a modulo-3 sequence had been created in the multiplication step, the elements 
would be multiplied by 3 as will be seen later. The multiplication step is a step in 
which the combined sequences are multiplied by the modulo of the interleaving 

20 sequence desired to be created. 

This methodology can be extended to any modulo desired. Once the 
sequence 1-2 elements have been multiplied times 2, the values are placed in row 3 
of table 2. The next step is to add to each element, now multiplied by modulo-N 
(here N equals 2) the modulo-N of the position of the element within the multiplied 

25 sequence i.e. the modulo sequence designation. Therefore, in a modulo-2 

sequence (such as displayed in table 2) in the 0th position the modulo-2 value of 0 
(i.e. a value of 0) is added. To position 1 the modulo-2 value of 1 (i.e. a value of 1) 
is added, to position 2 the modulo-2 value of 2 (i.e. a value of 0) is added. To 
position 3 the modulo-2 value of 3 is (i.e. a value of 1) is added. This process 

30 continues for every element in the sequence being created. Modulo position number 
as illustrated in row 4 of table 2 is then added to the modulo multiplied number as 
illustrated in row 3 of table 2. The result is sequence 5 as illustrated in row five of 
table 2. Similarly, in table 3, sequence 3 and sequence 4 are interspersed in order 
to create sequence 3-4. In row 1 of table 4, the position of each element in 

35 sequence 3-4 is listed. In row 3 of table 4 each element in the sequence is 

multiplied by the modulo (in this case 2) of the sequence to be created. Then a 
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modulo of the position number is added to each multiplied element. The result is 
sequence 6 which is illustrated in row 5 of table 4. 

It should be noted that each component sequence in the creation of any 
modulo interleaver will contain all the same elements as any other component 
sequence in the creation of a modulo interleaver. Sequence 1 and 2 have the same 
elements as sequence 3 and 4. Only the order of the elements in the sequence are 
changed. The order of elements in the component sequence may be changed in 
any number of a variety of ways. Four sequences have been illustrated as being 
created through the use of interleaving matrix and a seed sequence, through the use 
of the inverse interleaving of a seed sequence, through the use of a timed reversed 
interleaving of a seed sequence and through the use of an inverse of a time 
interleaved reverse of a seed sequence. The creation of component sequences are 
not limited to merely the methods illustrated. Multiple other methods of creating 
randomized and S randomized component sequences are known in the art. As long 
as the component sequences have the same elements (which are translated into 
addresses of the interleaving sequence) modulo interleaves can be created from 
them. The method here described is a method for creating modulo interleaves and 
not for evaluating the effectiveness of the modulo interleaves. Effectiveness of the 
modulo interleaves may be dependent on a variety of factors which may be 
measured in a variety of ways. The subject of the effectiveness of interleaves is 
one currently of much discussion in the art. 

Table 5 is an illustration of the use of sequence 1 , 2, and 3 in order to create a 
modulo-3 interleaving sequence. In row 1 of table 5 sequence 1 is listed. In row 2 
of table 5 sequence 2 is listed and in row 3 sequence 3 is listed. The elements of 
each of the three sequences are then intespesed in row 4 of table 5 to create 
sequence 1-2-3. 

In table 6 the positions of the elements in sequence 1-2-3 are labeled from 0 
to 17. Each value in sequence 1-2-3 is then multiplied by 3, which is the modulo of 
the interleaving sequence to be created, and the result is placed in row 3 of table 6. 
In row 4 of table 6 a modulo-3 of each position is listed. The modulo-3 of each 
position listed will then be added to the sequence in row 3 of table 3, which is the 
elements of sequence 1-2-3 multiplied by the desired modulo, i.e. 3. Sequence 7 is 
then the result of adding the sequence 1-2-3 multiplied by 3 and adding the modulo- 
3 of the position of each element in sequence 1-2-3. The resulting sequence 7 is 
illustrated in table 7 at row 5. As can be seen, sequence 7 is a sequence of 
elements in which the element in the 0 position mod 3 is 0. The element in position 
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1 1 mod 3 is 1 . The element in position 2 mod 3 is 2. The element in position 3 mod 3 
is 0 and so forth. This confirms the fact that sequence 7 is a modulo-3 interleaving 
sequence. Similarly, sequence 5 and 6 can be confirmed as modulo-2 interleaving 
sequences by noting the fact that each element in sequence 5 and sequence 6 is an 

5 alternating even and odd (i.e. modulo-2 equals 0 or modulo-2 equals 1) element. 

Figure 14C is a graphical illustration of creating a modulo-4 sequence from 
four component sequences. In table 7 sequences 1, 2, 3 and 4 from Figure 14A are 
listed. The elements of sequence 1, 2, 3 and 4 are then interspersed to form 
sequence 1-2-3-4. 

10 In table 8 row 1 the positions of each element in sequence 1-2-3-4 are listed. 

In row 3 of table 8 each element of sequence 1-2-3-4 is multiplied by a 4 as it is 
desired to create a modulo-4 interleaving sequence. Once the elements of 
sequence 1-2-3-4 have been multiplied by 4 as illustrated in row 3 of table 8, each 
element has added to it a modulo-4 of the position number, i.e. the modulo 

15 sequence designation of that element within the 1-2-3-4 sequence. The multiplied 
value of sequence 1-2-3-4 is then added to the modulo-4 of the position in sequence 
8 results. Sequence 8 is listed in row 5 of table 8. To verify that the sequence 8 
generated is a modulo-4 interleaving sequence each number in the sequence can 
be divided mod 4. When each element in sequence 6 is divided modulo-4 sequence 

20 of 0, 1, 2, 3, 0 t 1 t 2 f 3, 0, 1, 2, 3 etc. results. Thus, it is confirmed that sequence 8 is 
a modulo-4 interleaving sequence, which can be used to take an input sequence of 
tuples and create a modulo interleaved sequence of tuples. 

Figure 15 is a general graphical illustration of trellis-coded modulation (TCM). 
In Figure 15, input tuples designated 1501 are coupled into a trellis encoder 1503. 

25 Input tuples, for illustration purposes are designated T 0 , T 1f T 2 and T 3 . Within the 
trellis encoder 1503 the input tuples 1501 are accepted by a convolutional encoder 
1505. The input tuples that have been convolutionally encoded are mapped in a 
mapper 1507. The TCM process yields a signal constellation represented as a set 
of amplitude phase points (or vectors) on an In phase Quadrature (l-Q) plane. An 

30 example of such vectors illustrated at 1509, 1511, 1513, and 1515. The vector 

represented in the l-Q (In phase and Quadrature) illustration is well known in the art. 
The process of convolutionally encoding and mapping when taken together is 
generally referred to as trellis-coded modulation. A similar process called turbo 
trellis-coded modulation (TTCM) is illustrated in Figure 16. 

35 Figure 16 is a graphical illustration of TTCM (Turbo Trellis Coded Modulation) 

encoding. In Figure 16 input tuples 1601 are provided to a parallel concatenated 
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1 (turbo) encoding module 1603. The parallel concatenated turbo encoding module 
1603 may comprise a number of encoders and interleaves. Alternatively, the 
parallel concatenated encoder 1603 may comprise a minimum of two encoders and 
one interleaves The output of the turbo encoder is then provided to an output 

5 selection and puncturing module. In module 1605 outputs are selected from the 
constituent encoders of the module 1603. The selection of outputs of the different 
encoders is sometimes termed puncturing by various sources in the art, because 
some of the code bits (or parity bits) may be eliminated). Selection of outputs of the 
constituent encoders within the present disclosure will be referred to herein as 

10 selecting. The term selecting is used because, in embodiments of the present 

invention, encoded tuples are selected from different encoders, but encoded tuples 
corresponding to each of the input tuples are represented. For example, there may 
be an encoder designated the odd encoder from which tuples corresponding to 
encoded versions of odd input tuples are selected. The other encoder may be 

15 termed an even encoder in which- the coded versions of the even tuples are 
selected. This process is termed selecting because even though alternating 
encoded tuples are selected from different encoders a coded version of each input is 
represented. That is, in the selection process though some encoded symbols are 
discarded from one encoder and some encoded symbols are discarded from other 

20 constituent encoder(s) the selection and modulo interleaving process is such that 
encoded versions of all input elements are represented. By modulo encoding and 
selecting sequentially from all encoders, encoded versions of all input bits are 
represented. The term puncturing as used herein will be used to describe discarding 
parts or all of encoded tuples which have already been selected. The selected 

25 tuples are provided to a mapping 1607. In embodiments of the present invention the 
mapping may be dependent on the source of the tuple being mapped. That is, the 
mapping may be changed for example depending on whether the tuple being 
mapped has been encoded or not. For example, a tuple from one of the encoders 
may be mapped in a first mapping. An uncoded tuple which has bypassed the 

30 encoder however may be mapped in a second mapping. Combination tuples in 

which part of the tuple is encoded and part of it is uncoded may also have different 
mappings. A combination of 3 blocks - block 1603, parallel concatenated encoding, 
block 1605, output selection and puncturing, and block 1607 mapping comprise what 
is known as the turbo trellis-coded modulation (TTCM) encoder 1609. The output of 

35 the TTCM encoder is a series of constellation vectors as illustrated by examples at 
1611, 1613, 1615 and 1617. 
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Figure 17 is a graphical illustration of a rate 2/3 encoder according to an 
embodiment of the invention. In Figure 17, input tuples T 0 and T, represented at 
1701 are provided to odd encoder 1703. Tuple T 0 comprises bits, b 0 and b, tuple T, 
comprises bits b 2 and b 3 . The input tupies T 0 and T, are also provided to an 
interleaver 1705. Interleaver 1705 accepts input tuples (such as T 0 and T,) and after 
interleaving, provides the interleaved tuples to the even encoder 1709. When odd 
encoder 1703 is accepting tuple T 0 , comprising bits b„and b, , even encoder 1709 is 
accepting an interleaved tuple comprising bits i 0 , and i v Similarly, when odd encoder 
1703 is accepting tuple T, comprising bits b 2 and b 3 even encoder 1709 is accepting 
an interleaved tuple comprising bits i 2 and i 3 . At each encoder clock (EC) both 
encoders accept an input tuple. The interleaver 1703 is a modulo-2 (even/odd) ST 
interleaver. Each encoder accepts every input tuple. The even/odd designation 
refers to which encoded tuple is selected to be accepted by the mapper 1715. By 
maintaining an even/odd interleaving sequence and by selecting encoded tuples 
alternatively from one then the other encoder, it can be assured that an encoded 
version of every input tuple is selected and passed on to the mapper 1715. For 
example, the encoded tuple 1711, comprising bits Cg and c 4 , and c s and 
corresponding to tuple T, is selected and passed onto mapper 1715, which maps 
both even and odd selections according to map 0. 

The encoded tuple q,, c, and Cj, corresponding to input tuple T 0 is not selected 
from the odd encoder 1703. Instead, the tuple comprising bits c' 0 , c\, and c' 0 , which 
corresponds to the interleaved input i 0 and i, is selected and passed on to mapper 
1715, where it is mapped using map 0. 

Accordingly, all the components of each tuple are encoded in the odd encoder 
and all components of each tuple are also encoded in the even encoder. However, 
only encoded tuples corresponding to input tuples having an odd modulo sequence 
designation are selected from odd encoder 1703 and passed to the mapper 1715. 
Similarly only encoded tuples corresponding to input tuples having an even modulo 
sequence designation are selected from even encoder 1709 and passed to mapper 
1703. Therefore, the odd and even designation of the encoders designate which 
tuples are selected from that encoder for the purposes of being mapped. 

Both encoder 1703 and 1709 in the present example of Figure 17 are 
convolutional, nonsystematic, recursive encoders according to Figure 5. Although 
only encoded versions of odd tuples are selected from encoder 1703, and only 
encoded versions of even tuples are selected from encoder 1709, because both 
encoders have memory, each encoded output tuple not only contains information 
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from the tuple encoded, but also from previous tuples. 

The even/odd encoder of Figure 17 could be modified by including modulo-N 
interleaving, modulo-N interleaving could be accomplished by adding the appropriate 
number of both interleavers and encoders, to form a modulo-N TTCM encoder. 
Additionally, other configurations may be possible. For example, interleaver 1705 
may be a ST interleaver. As an alternate another interleaver may be added prior to 
odd encoder 1703. For example, if a bit interleaver, to separate the input tuple bits 
were added prior to encoder 1703, and interleaver 1705 were an IT interleaver, the 
overall effect would be similar to specifying interleaver 1705 to be an ST interleaver. 

Both encoders 1703 and 1709 are rate 2/3 encoders. They are both 
nonsystematic convoiutional recursive encoders but are not be limited to such. 

The overall TTCM encoder is a 2/3 encoder because both the odd encoder 
1703 and the even encoder 1709 accept an input tuple comprising 2 bits and output 
an encoded output tuple comprising 3 bits. So even though the output to mapper 0 
switches between even and odd encoders, both encoders are rate 2/3 and the 
overall rate of the TTCM encoder of Figure 17 remains at 2/3. 

Figure 18 is a graphical illustration of a rate Vz TTCM encoder implimented 
using the constituent rate 2/3 base encoders, according to an embodiment of the 
invention. In Figure 18, exemplary input tuples T 0 and T, are provided to the TTCM 
encoder 1800. The T 0 tuple comprises a single bit b 0 and the T, tuple comprises a 
single bit b v b 0 and corresponding to tuples T 0 and T, are provided to odd 
encoder 1803. Both b 0 and b 1 are also provided to interleaver 1805. At the time 
when odd encoder 1803 is accepting b 0 even encoder is accepting i 0 . i 0 is an output 
of the interleaver 1805. Similarly, i 1 is a output of interleaver 1805 that is provided to 
even encoder 1809 at the same time that bit b t is provided to odd encoder 1803. 
The interleaver 1805 is an odd/even interleaver (modulo-2 ). In such a manner 
when an odd tuple is being provided to odd encoder 1803, an interleaver odd tuple is 
being provided to even encoder 1809. When an even tuple is being provided to odd 
1803, an even interleaved tuple is being provided to even encoder 1809. In order to 
achieve a rate Vz code from rate 2/3 constituent encoders, in addition to an input 
comprising a single input bit, a constant bit value provided to 1811 is a second input 
of each of the constituent rate 2/3 encoders 1 803 and 1 809. In Figure 1 8A the input 
bit is shown as being a 0 but could just as easily be set to a constant value of 1 . 
Additionally, each encoder input bit might be inputted twice to the odd encoder 1803 
and the even encoder 1809 as illustrated in Figure 18B. Multiple other 
configurations are possible. For example both encoders might receive both input 
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1 tuples as illustrated in Figure 18C f or one of the inputs might be inverted as in Figure 
18E. Additionally hybrid combinations, such as illustrated in Figure 18D are 
possible. 

The output of odd encoder 1803, which corresponds to input tuple T 0 

5 comprises bits c 0 , c 1t c^ The output tuple of odd encoder 1803 corresponding to 
tuple T, comprises bits C3, c 4 , and c 5 . At encoder clock EC 0 the even encoder 1809 
has produced an encoded output tuple having bits c f 0 , c\ and c' 2 . One of the three 
encoded bits, in the present illustration c' 2 , is punctured i.e. dropped and the 
remaining 2 bits are then passed through to mapper 1813. During the odd encoder 

10 clock OC 1 two of three of the encoded bits provided by odd encoder 1803 are 

selected and passed to mapper 1813. Output bit c 4 is illustrated as punctured, that 
is being dropped and not being passed through the output mapper 1813. Mapper 
1813 employs map number 3 illustrated further in Figure 24. For each encoder clock 
a single input tuple comprising 1 bit is accepted into the TTCM encoder 1800. For 

15 each clock a 2-bit encoded quantity is accepted by mapper 1813. Because for each 
one bit provided to the encoder, 2 bits are outputted, therefore the encoder is a rate 
Vz encoder. The odd and even encoders in the present embodiment are 
nonsystematic, convolution^, recursive encoders, but are not limited to such. The 
encoders may be any combination, for example such as systematic, block encoders. 

20 Interieaver 1 805 is an odd/even interleaver and so odd output tuples are accepted 
by the mapper 1813 from odd encoder 1803 and even encoded tuples are accepted 
by the mapper 1813 from even encoder 1809. In such a manner, all input tuples are 
represented in the output accepted by mapper 1813, even though some of the 
redundancy is punctured. Mapper 1813 utilizes map 3 as illustrated in Figure 25 for 

25 use by rate Vz TTCM encoder 1 800. 

Figure 19 is a graphical illustration of a rate 3/4 TTCM encoder, having 
constituent 2/3 rate encoders, according to an embodiment of the invention. In 
Figure 19 the input tuples T 0 and T 1f illustrated at 1901, comprise 3 bit input tuples. 
Input tuple T 0 comprises bits b 0 , b, and b 2 . Input tuple T A comprises bits b 3 , b 4 and 

30 b 5 . Bit bj of input tuple T 0 is underlined as is bg of input tuple T v Bits bg and bg are 
underlined because neither of these bits will pass through either encoder. Instead, 
these bits will be concatenated to the output of the even or odd encoder and the 
resulting in a 4 bit tuple provided to mapper 191 1 . b 0 and b, of input tuple T 0 are 
provided to odd encoder 1903. At the same time that b 0 and are being accepted 

35 by the odd encoder 1903, interleaved bits i 0 and i 1 are being accepted by even 

encoder 1909. Interleaver 1905 is an odd/even (module-2) type interieaver. The 
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1 encoders illustrated at 1903 and 1909 are the encoders illustrated in Figure 5. 

Encoders 1903 and 1909 are the same as the encoders illustrated at 1803 and 1809 
in Figure 18, 1703 and 1709 in Figure 17 and as will be illustrated at 2003 and 2009 
in Figure 20A and 2103 and 2109 in Figure 21 A In other words, the odd encoder 

5 and even encoder are rate 2/3, nonsystematic, convolutional recursive encoders. 
Other types of encoders may however be used, and types may be mixed and 
matched as desired. 

Figure 17 through 21 are encoding arrangements that utilize the same basic 
encoder as illustrated in Figure 5. In Figure 19, encoders 1903 and 1909 are 

10 illustrated as separate encoders for conceptual purposes. Those skilled in the art 
will realize that a single encoder may be used and may be time-shared. Figures 17 
through 21 are conceptual type Figures and are figures that represent general 
concepts. They depict the general concept accurately regardless of the particular 
implementation of circuitry chosen. In the rate 3/4 encoder of Figure 1 9, the input 

15 tuples T 0 , T 1 (and all other input tuples to the encoder of Figure 1 9) comprise 3 bits. 
Since encoders 1903 and 1909 are rate 2/3 encoders with 2 input bits, then only 2 
bits can be accommodated at a particular time. Accordingly, bit bj of tuple T 0 and bit 
bg of tuples T, bypass the encoders completely, bg is concatenated to the output of 
odd encoder 1903, i.e. Oj, c 4 and c 5 the combination of encoder tuple c,, c 4 , c 5 and bg 

20 are then provided to mapper 191 1 which maps the output according to map 2. Map 
2 is illustrated in Figure 24. Similarly, the output of even encoder 1909, comprising 
encoded bits c f 0l c', and c' 2> is combined with bit fc^ of input tuple T 0 and then the 
combination of b^ c' 0 , c' 1t c' 2 is provided to mapper 191 1 . In such a way the three 
bits of encoded tuples are converted into four bits for mapping in mapper 1911. The 

25 four bits mapped comprise the three encoded bits from either the odd or even 
encoder plus a bit from the input tuple which has by passed both encoders. 

Figure 20A is a graphical illustration of a rate 5/6 TTCM encoder, having 
constituent 2/3 rate basic encoders, according to an embodiment of the invention. In 
Figure 20A the input tuples T 0 and T, are illustrated at 2001 . Input tuple T 0 

30 comprises five bits, b 0 through b 4 . Input tuple T t also comprises five bits, b 5 through 
b 9 . ^ of tuple T 0 and bg of tuple T n are underlined to illustrate that they do not pass 
through either encoder. The odd encoder 2003 accepts b 0 and b, during a first 
encoder clock time during which even encoder 2009 is accepting interleaved bits i 0 
and i v Bits i 0 and i 1 are the outputs of the interleaver 2005 that correspond to the 

35 same time during which inputs b 0 and b n are accepted from the odd encoder. 

Similarly, the odd encoder 2003 is accepting bits b 2 and b 3 at a time when the even 
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encoder 2009 is accepting bits i 2 and i 3 . Similarly, input tuple T 1t is separated into 2 
bit encoder input tuples because the constituent encoders are rate 273 encoders 
which accept 2 bits input and produce three encoded bits out. Because each input 
tuple 2001 is five bits and because each encoder allows only a 2 bit input, input tuple 
T 0 is separated into encoder tuple b 0 and b 1 and encoder tuple b 2 and b 3 . The 
encoder therefore, must process two encoder input tuples for each input tuple 2001. 
Therefore, a single input tuple 2001 will require two encoder clocks for processing. 
The even encoder 2009 encodes tuple i 0 and i 1 and produces corresponding output 
code bits c f 0 , c\ and c' z After processing i 0 and i 1 the even encoder 2009 processes 

1 2 and i 3 The output of even encoder 2009, which corresponds to input bits i 2 and i 3 
is c's, c' 4 and c' 5 . The odd encoder 2003 processes a first tuple b 0 and b t and then 
processes a second tuple b 2 and b 3 . Tuple b 0 and b, are accepted by encoder 2003 
which produces a corresponding encoded 3 bit tuple c 0 , c 1 and c^. After accepting b 0 
and b v the odd encoder 2003 accepts second tuple b 2 and b 3 and produces a 
corresponding output Cg, c 4l and c 5 . Encoder output c' 0 , c', and c 2 corresponding to 
encoder tuple i n and i 0 are provided to mapper 2011 Mapper 201 1 uses map 0 to 
map Cq, c\ and c' 2 . Subsequently to producing c' 0 , c', and c' 2 even encoder 2009 
accepts i 2 and i 3 and produces output 03, c 4l and c 5 . Instead of selecting C3, c 4J c 5 to 
be mapped, uncoded bit ^ is combined with interleaved bits i 2 and i 3 and selected. 
i 2 , i 3 and ^ are then accepted by mapper 201 1 1 which employs map 1 to map bits i 2 , 

1 3 and ^ Therefore, with respect to the overall input tuple T 0 five bits are input into 
the TTCM encoder 2000 and six bits are passed to mapper 201 1 . In other words, a 
coding rate of 5/6 is generated. Similarly, odd encoder 2003 encodes bits b 5 and b 6 
and produces coded bits c 6 , 07 and c 8 . Subsequently odd encoder 2003 encodes 
bits b 7 and b 8 and produces coded bits c 9l c 10 and c 1v Cg, o? and c 8 are passed to the 
encoder 2001 as is where they are mapped using map 0. Encoded bit Cg, c 10 and 
c 1v however, are punctured, i.e. they are dropped and instead bits b 7 , b 8 and b 9 are 
substituted. b 7 , b 6 and be, are passed to encoder 201 1 which uses map 1 to map b 7 , 
b 8 , and bg. A graphical illustration of map 0 can be found in Figure 22 and a 
graphical illustration of Map 1 can be found in Figure 23. In the manner just 
described, a rate 5/6 TTCM encoder is realized from two component rate 2/3 
encoders. Interleaver 2005 is similar to interleaver 1705, 1805, 1905, 2005 and 
2105 which also are even/odd or modulo-2 type interleaves. Other modulo 
interleaves, just as with all other embodiments illustrated in figures 17 through 21 , 
can be realized by adding additional intedeavers and encoders and by selecting 
outputs and uncoded bits in a straight format manner similar to that illustrated in 
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Figure 20A. 

Figure 20B represents an alternate encoding that will yield the same coding 
rate as Figure 20A. 

Figure 21 A is a graphical illustration of a rate 8/9 TTCM encoder realized 
using constituent rate 2/3 encoder, according to an embodiment of the invention. To 
illustrate the functioning of TTCM rate 8/9 encoder 2100 two sequential input tuples 
T 0 and T lt illustrated at 2101, will be considered. Since the constituent encoders are 
rate 2/3 having two bits as input and three bits as output, the input tuples will have to 
be subdivided into encoder tuples. In other words, the input tuples will be divided 
into tuple pairs which can be accepted by odd encoder 2103 and even encoder 
2109. Odd encoder 2103 accepts tuple pair b 0 and b„ pair b 2 and b 3 , pair b 4 and b 5 , 
pair b 8 and b 9 , pair b 10 and b 11t and pair b 12 and b 13 sequentially, since the basic 2/3 
rate encoder can only accept one pair of input bits at a time. Even encoder 
correspondingly accepts input pairs i 0 and i 1t input pair i 2 and i 3 , input pair i 4 and i 5 , 
input pair i 8 and i 9 , input pair i 10 and i 1tl and input pair i 12 and i 13 sequentially. The 
pairs accepted by the even encoder correspond to tuple pairs having the same 
numbering accepted by the odd encoder at the same time. That is i 0 and i, are 
accepted by the even encoder 2109 during the same time period as input pair b 0 and 
b 1 is accepted by the odd encoder 2103. Odd and even encoders then produce 
encoded outputs from the input pairs accepted. Even encoder 2909 produces a first 
encoded output triplet c' 0 , c\ and c' 2 followed by a second output triplet c' 3 , c- 4 and c' 5 
followed by a third output triplet c'e, c' 7 and c' 8 (a triplet is a 3 bit tuple). The first 
output triplet c' 0 , c\ and c\ is accepted by the mapper 2111. The mapper 2111 
utilizes map 0 to map encoded output c' 0 , c' t and c' 2 . Encoded output bits c' 3l c f 4 and 
c' 5 however are punctured, that is not sent to the mapper. Instead of sending o\ % c' 4 
and c' 5 to the mapper 21 1 1 the triplet of bits comprising i 2 , i 3 and are sent to the 
mapper 2111. The mapper 2111 utilizes map 1 as the mapping for the triplet i 2 , i 3 , 
be. Encoded triplet c f 6 , c' 7 and c' 8 is also punctured. That is, it is not sent to the 
mapper 21 11 . Instead, i 4) i 5 and b 7 is sent to the mapper 21 1 1 which uses map 1 to 
map input triplet i 4) i 5 and b 7 . Because eight bits corresponding to tuple T 0 are 
accepted by the even encoder 2109 and nine bits are output into the mapper 21 1 1 
the overall encoder 2100 is a rate 8/9 encoder. Similarly, input tuple T, is encoded 
by the odd encoder 2103. The output triplet from the odd encoder Cg, c 10 and c n 
corresponds to input tuple b 8 and b 9 . Next, odd encoder 2103 produces an encoded 
output triplet c 12l c 13 and c 14l which is an output triplet corresponding to input pair b 10 
and b 1v Subsequently odd encoder 2103 produces output triplet c 15 , c 16 and c 17 . 
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Output triplet c 15 , c 16 and c 17 corresponds to input pair b 12 and b 13 . Output triplet Cg, 
c 10 and c t1 are sent to the mapper 2111 which uses map 0 to map output triplet Cg, 
c 10 and c 1v Output triplet c 12 . c 13 and c 14 however is punctured and in its place b 10) 

and b 14 is sent to mapper 2111 where map 1 is employed to map the input triplet 
b 10l b„ and b 14 . The encoder triplet c 15 . c 16 and c 17 is also punctured and a triplet 
comprising b 12 , b 13 and b 15 is provided to mapper 2111. Map 1 is used to map the 
input triplet b 12 , b 13 and b 15 . In the manner just described an 8/9 encoder is 
fabricated from two constituent rate 2/3 encoder. 

From the foregoing TTCM encoder examples of Figures 17 through 21 it is 
seen that the basic rate 2/3 encoders can be used in a variety of configurations to 
produce a variety of coding rates. 

The basic constituent encoders illustrated in Figures 17 through 21 are rate 
2/3, nonsystematic, convolutional recursive encoders. These illustrations represent 
a few examples. Different types of encoders and even different rates of encoders 
may yield many other similar examples. Additionally, encoder types can be mixed 
and matched; for example, a recursive nonsystematic convolution encoder may be 
used with a nonrecursive systematic block encoder. 

Additionally, the interleaves illustrated in Figures 17 through 21 are modulo-2 
(even/odd) ST interleaves. Those skilled in the art will realize that IT type 
interleaves may be used alternatively in the embodiments of the invention illustrated 
in Figures 17 through 21. 

Additionally the TTCM encoders illustrated in Figures 17 through 21 may 
employ modulo-N encoding systems instead of the modulo-2 (even/odd) encoding 
systems illustrated. For example, each of the constituent encoder - modulo-2 
interleaver subsystems may be replaced by modulo-N subsystems such as 
illustrated in Figure 8A. By maintaining the same type puncturing and selecting with 
each encoder as displayed with the even/odd encoders of Figures 17 through 21 
and extending it to modulo-N systems, such as illustrated in Figure 8A, the same 
coding rates can be maintained in a modulo-N system for any desired value N. 

Figure 21 B represents an alternate encoding that will yield the same coding 
rate as Figure 21 A 

Figure 22 is a graphical illustration of map 0 according to an embodiment of 
the invention. Map 0 is used in the implementation of the rate 2/3 encoder as 
illustrated in Figure 17. Map 0 is also utilized in rate 5/6 encoder illustrating in Figure 
20A and rate 8/9 encoder illustrated in Figure 21 A. 

Figure 23 is a graphical illustration of map 1 according to an embodiment of 
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1 the invention. Map 1 is used by the mapper in the rate 5/6 encoder in Figure 20A, 
and in the mapper in the rate 8/9 encoder in Figure 21 A. 

Figure 24 is a graphical illustration of map 2 according to an embodiment of 
the invention. Map 2 is utilized in the fabrication of the rate 3/4 encoder as 

5 illustrated in Figure 19. 

Figure 25 is a graphical illustration of map 3 according to an embodiment of 
the invention. Map 3 is used in the rate Vi encoder as depicted in Figure 18. 

Maps 0 through 3 are chosen through a process different from the traditional 
approach of performing an Ungerboeck mapping (as given in the classic work 

10 "Channel Coding with Multilevel/Phase Signals" by Gottfried Ungerboeck, IEEE 
Transactions on Information Theory Voi. 28 No. 1 January 1982). In contrast in 
embodiments of the present invention, the approach used to develop the mappings 
was to select non Ungerboeck mappings, then to measure the distance between the 
code words of the mapping. Mappings with the greatest average effective distance 

15 are selected. Finally the mappings with the greatest average effective distance are 
simulated and those with the best performance are selected. Average effective 
distance is as described by S. Dolinar and D. Divsalar in their paper 'Weight 
Distributions for Turbo Codes Using Random and Non-Random Permeations," TDA 
progress report 42-121, JPL, August 1995. 

20 Figure 26 is a TTCM decoder according to an embodiment of the invention. 

Figure 26 illustrates a block diagram of the TTCM decoder corresponding to the 
TTCM encoder described above. The TTCM decoder includes a circular buffer 
2602, a metric calculator module 2604, two soft-in soft-out (SISO) modules 2606, 
2608, two interleavers 2610, 2612, a conditional points processing module 2614, a 

25 first-in first-out (FIFO) register 261 6, and an output processor 261 8. 

The TTCM decoder of Figure 26 impliments a MAP (Maximum A Posteriori) 
probabilrty decoding algorithm. 

The MAP Algorithm is used to determine the likelihood of the possible 
particular information bits transmitted at a particular bit time. 

30 Turbo decoders, in general, may employ a SOVA (Soft Output Viterbi 

Algorithm) for decoding. SOVA is derived from the classical Viterbi Decoding 
Algorithm (VDA). The classical VDA takes soft inputs and produces hard outputs a 
sequence of ones and zeros. The hard outputs are estimates of values, of a 
sequence of information bits. In general, the SOVA Algorithm takes the hard 

35 outputs of the classical VDA and produces weightings that represent the reliability of 
the hard outputs. 
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1 The MAP Algorithm, implimented in the TTCM decoder of Figure 26, does not 

produce an intermediate hard output representing the estimated values of a 
sequence of transmitted information bits. The MAP Algorithm receives soft inputs 
and produces soft outputs directly. 

5 The input to the circular buffer i.e. input queue 2602 is a sequence of received 

tuples. In the embodiments of the invention illustrated in Figure 26, each of the 
tuples is in the form of 8-bit in-phase (I) and 8-bit quadrature (Q) signal sample 
where each sample represents a received signal point or vector in the l-Q plane. 
The circular buffer 2602 outputs one tuple at a time to the metric calculator 2604. 

10 The metric calculator 2604 receives I and Q values from the circular buffer 

2602 and computes corresponding metrics representing distances form each of the 
8 members of the signal constellation (using a designated MAP) to the received 
signal sample. The metric calculator 2604 then provides all eight distance metrics 
(soft inputs) to the SISO modules 2606 and 2608. The distance metric of a received 

15 sample point from each of the constellation points represents the log likelihood 

probability that the received sample corresponds to a particular constellation point. 
For rate 2/3, there are 8 metrics corresponding to the points in the constellation of 
whatever map is used to encode the data. In this case, the 8 metrics are equivalent 
to the Euclidean square distances between the value received and each of the 

20 constellation whatever map is used to encode the data- 
Si SO modules 2606 and 2608 are MAP type decoders that receive metrics 
from the metric calculator 2604. The SISOs then perform computations on the 
metrics and pass the resulting A Posteriori Probability (APoP) values or functions 
thereof (soft values) to the output processor 261 8. 

25 The decoding process is done in iterations. The SISO module 2606 decodes 

the soft values which are metrics of the received values of the first constituent code 
corresponding to the constituent encoder for example 1703 (Figure 17). The SISO 
module 2608 decodes the soft values which are the APoP metrics of the received 
values of the second constituent code corresponding to the constituent encoder for 

30 example 1709 (Figure 17). The SISO modules simultaneously process both codes 
in parallel. Each of the SISO modules computes the metrics corresponding to the 
input bits for every bit position of the in the block of 10K tuples (representing a 
exemplary block of date), and for each of the trellis states that the corresponding 
encoder could have been in. 

35 One feature of the TTCM decoder is that, during each iteration, the two SISO 

modules 2606, 2608 are operating in parallel. At the conclusion of each iteration, 
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1 output from each SISO module is passed through a corresponding interleaver and 
the output of the interleaver is provided as updated or refined A Priori Probability 
(APrP) information to the input of other cross coupled SISO modules for the next 
iteration. 

5 After the first iteration, the SISO modules 2706, 2708 produce soft outputs to 

the interleaver 2610 and inverse interleaver 2612, respectively. The interleaver 
2610 (respectively, inverse interleaver 2612) interleaves the output from the SISO 
module 2606 (respectively, 2608) and provides the resulting value to the SISO 
module 2608 (respectively, 2606) as a priori information for the next iteration. Each 

10 of the SISO modules use both the metrics from the metric calculator 2604 and the 
updated APrP metric information from the other cross coupled SISO to produce a 
further SISO Iteration. In the present embodiment of the invention, the TTCM 
decoder uses 8 iterations in its decoding cycle. The number of iterations can be 
adjusted in firmware or can be changed depending on the decoding process. 

15 Because the component decoders SISO 2606 and 2608 operate in parallel, 

and because the SISO decoders are cross coupled, no additional decoders need to 
be used regardless of the number of iterations made. The parallel cross coupled 
decoders can perform any number of decoding cycles using the same parallel cross 
coupled SISO units (e.g. 2606 and 2608). 

20 At the end of the 8 iterations the iteratively processed APoP metrics are 

passed to the output processor 2618. For code rate 2/3, the output processor 2618 
uses the APoP metrics output from the interleaver 2610 and the inverse interleaver 
2612 to determine the 2 information bits of the transmitted tuple. For code rate 5/6 
or 8/9, the output from the FIFO 2616, which is the delayed output of the conditional 

25 points processing module 2614, is additionally needed by the output processor 2618 
to determine the uncoded bit, if one is present. 

For rate 2/3, the conditional points processing module 2614 is not needed 
because there is no uncoded bit. For rate 5/6 or 8/9, the conditional points 
processing module 2614 determines which points of the received constellation 

30 represent the uncoded bits. The output processor 2618 uses the output of the 
SISOs and the output of the conditional points processor 2614 to determine the 
value of the uncoded bit(s) that was sent by the turbo-trellis encoder. Such 
methodology of determining the value of an uncoded bit(s) is well known in the art as 
applied to trellis coding. 

35 Figure 27 is a TTCM modulo-4 decoder according to an embodiment of the 

invention. The modulo four decoder of Figure 27 is similar to the modulo-2 decoder 
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1 illustration in Figure 26. The functions of the input queue 2802, metric calculator 

2804, conditional points processor 2814, and first in first out (FIFO) 2816 are similar 
to their counterparts in Figure 26. The signals that will be decoded by the TTCM 
modulo-4 decoder Figure 27 is one that has been coded in a modulo-4 interleaving 

5 system. Therefore, instead of having merely even and odd SISOs and interleaves, 
SISO 0,1,2 and 3 are used as are interleaver 0, 1 , 2 and 3. Because the data has 
been encoded using a modulo-4 interleaving system, SISOs 0, 1, 2 and 3 can 
operate in parallel using interleaver 0, 1, 2 and 3. Once the SISOs 0 through 3 have 
processed through the points corresponding to the metrics of the points received in 

10 the input queue, the points can then be passed on to output process 2818. Output 
process 2818 will then provide decoded tuples. 

Figure 28 is a graphical illustration of a modulo-N and encoding and decoding 
system according to an embodiment of the invention. In Figure 28, the encoder 
2800 is a moduio-N encoder. The modulo-N encoder illustrated has N encoders and 

15 N-1 interleaves. The selector, 2801 selects encoded tuples sequentially from the 
output of encoders 0 through N. Selector 2801 then passes the selection onto the 
mapper which applies the appropriate mapping. The appropriately mapped data is 
then communicated over a channel 2803 to an input queue 2805. The functions of 
input 2805, metric calculator 2807, conditional points processor 2809 and FIFO 281 1 

20 are similar to those illustrated in Figures 26 and 2478. The decoder 2813 has N 

SISOs corresponding to the N encoders. Any desired amount of parallelism can be 
selected for the encoder decoder system with the one caveat that the modulo-N 
decoding must match the modulo-N encoding. By increasing the modulo of the 
system, more points which have been produced by the metric calculator 2807 can 

25 be processed at the same time. 

SISOs 0 through N process the points provided by the metric calculator in 
parallel. The output of one SISO provides A Priori values for the next SISO. For 
example SISO 0 will provide an A Priori value for SISO 1, SISO 1 will provide an 
A Priori value for SISO 2, etc. This is made possible because SISO 0 impliments a 

30 Map decoding algorithm and processes points that have a modulo sequence 

position of 0 within the block of data being processed, SISO 1 impliments a Map 
decoding algorithm and processes points that have a modulo sequence position of 1 
within the block of data being processed, and so forth. By matching the modulo of 
the encoding system to the modulo of the decoding system the decoding of the data 

35 transmitted can be done in parallel. The amount of parallel processing available is 
limited only by the size of the data block being processed and the modulo of the 
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encoding and decoding system that can be implimented. 

Figure 29 is a graphical illustration of the output of the TTCM encoder 
illustrated in Figure 17. Figure 29 retains the same convention that C stands for a 
coded bit. The output of the TTCM encoder of Figure 17 is represented by the 
sequences 2901 and 2903. The tuple sequence 2901 represents the actual output 
of rate 2/3rds encoder illustrated in Figure 17. During a first time period T 0) bits C 0) 

are output from the encoder. The source of bits C 0 , and C 2 represent 3 bits 
encoded by the even encoder 1709. These first 3 bits are mapped according to 
mapping sequence 2903. According to mapping sequence 2903 bits C 0 , C, and C 2 
are mapped using map 0 as illustrated in Figure 22. Together the tuple sequence 
and mapping identify the type of output of the rate 2/3rds encoder illustrated in 
Figure 17. 

The tuple C 3 , C 4 and C 5 is provided by the encoder of Figure 17 immediately 
after the tuple comprising C 0 , C, and C 2 . The tuple C 3 . C 4 and C 5 is been encoded in 
the odd encoder. The tuple sequence 2901 corresponding to time is the result of 
an encoding performed in the odd encoder 1703. 

In Figures 29 through and including Figure 33 the following conventions are 
adopted. Even encoder outputs will be shaded a light gray. The odd encoder 
outputs have no shading. In such a way the tuple sequence which comprises the 
output of the corresponding TTCM encoder can be identified. The gray shading 
denotes that the tuple was encoded in the even constituent encoder, and the lack of 
shading indicates that the tuple was encoded in the odd convolutional constituent 
encoder. Additionally uncoded bits that are associated with the even encoder data 
stream are shaded. 

A letter C will represent a coded bit which is sent and an underlined letter B 
will represent unencoded bits which have not passed through either constituent 
encoder and a B without the underline will represent a bit which is encoded, but 
transmitted in unencoded form. 

In time sequence T 2 the TTCM output is taken from the even encoder, 
accordingly the bit C 6 . C 7 and C 8 appear as a gray shaded tuple sequence indicating 
that they were encoded by the even encoder. At time T3 output tuple sequence 
2901 comprises C 9l C 10 and C„ which had been encoded by the odd encoder. All 
members of the tuple sequence for the rate 2/3rds encoder illustrated in Figure 17 
are mapped using map 0 as shown at mapping sequence 2903. The 
characterization of TTCM encoders output tuples using tuple sequence and mapping 
sequence will be used later when considering the decoding. For the present it is 
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only necessary to realize that the combination of the tuple sequence and mapping 
sequence correspond to its type. The tuple type completely specifies the output of 
the TTCM encoder for the purposes of decoding. 

Figure 30 is a graphical illustration of the tuple types produced by the TTCM 
encoder illustrated in Figure 18A. The TTCM encoder illustrated in Figure 18A is a 
rate % encoder. The rate 14 encoder illustrated in Figure 18A produces output tuples 
comprising 2 bits. The first tuple pair C 0 and C 1f corresponding to output time T 0l is 
produced by the even encoder 1 809 as indicated by the shading of the tuple. The 
next tuple corresponding to output time T- comprises coded bits C 2 and C 3 which 
have been encoded by the odd encoder 1809. Similarly, the tuple corresponding to 
time T 2 is produced by the even encoder and the tuple corresponding to time T 3 is 
produced by the odd encoder. All tuple sequences 3001 are mapped using to map 
0 as shown by the mapping sequence 3003. The combination of tuple sequence 
3001 and mapping sequence 3003 comprise the type of the tuple produced by the 
rate 14 TTCM encoder of Figure 18A. The type of tuples produced by the TTCM 
encoder of Figure 1 8A will be useful for the purposes of decoding the output tuples. 

Figure 31 is a graphical illustration illustrating the tuple types produced by the 
rate 3/4 encoder of Figure 1 9. The tuple sequence 3101 , representing the output of 
the TTCM encoder of Figure 19 is a sequence of 4 bit tuples. The output tuple 
corresponding to time T 0 is 4 bits. C 0 , C 1f C 2 and unencoded bit B 0 . Tuple sequence 
corresponding to time T 0 is mapped by map 2 as shown by mapping sequence 3103. 
Additionally, the tuple sequence 3101 during time T 0 is mapped by the even 
encoder, as illustrated by the shading. In other words, the uncoded bit Bq does not 
pass through either the even or odd encoder. It is however shown shaded as the 
tuple sequence, to which it is paired, is produced by the even encoder 1909. 

Similarly, the tuple sequence corresponding to T 2 has been produced by the 
even encoder. The tuple sequence corresponding to time T 2l i.e. C 6 , C 7 and C 8 , are 
produced by even encoder 1909 and paired with unencoded bit C 6l C 7 and C 8 
are produced by the even encoder. Combination C 6 , C 7) C 8 and B 2 are mapped 
according to map 2 as illustrated in Figure 24. 

Similarly, the tuple sequences produced by the TTCM encoder of Figure 19 
during times T, and T 3 are produced by the odd encoder and combined with an 
uncoded bit. During time T, the odd encoder encodes C 3) C 4 and C 5 . C 3 , C 4 and C 5 
along with B 1f are mapped in map 2. The tuple sequence produced during time T 3 is 
also a combination of the odd encoder and an encoded bit. As illustrated in Figure 
31 all tuple sequences are mapped using map 2. 
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Figure 32 is a graphical illustration of the tuple types produced by the rate 5/6 
encoder illustrated in Figure 20A. The first tuple corresponding to time T 0 comprises 
coded bits C 0 , C, and C 2 . The coded bits C 0 , C, and C 2 are mapped according to 
map 0. During time T„ bits B 0 , B, and Bj are produced by the encoder of Figure 
20A. B 0 , B, and B 2 represent data that is sent uncoded they are however shown as 
being grayed out because bits B, and B„ pass through the even encoder even 
though they are sent in uncoded form. The uncoded bits B 0> B, and Bj are mapped 
using map 1 . Similarly, the output of the encoder at time T 4 comprises coded bits 
C 6 , C 7 and C 8 which are mapped using map 0. During time period T s uncoded bits 
B 6 , B 7 and Bj form the output of the encoder. B 6 , B 7 and B„ are mapped using map 
1. 

During time period T 2 , bits C 3l C 4 and C s are selected from the odd encoder as 
the output of the overall 5/6 encoder illustrated in Figure 20A. Bits C 3 , C 4 and C s are 
mapped in mapper 0 and form the turbo trellis coded modulated output. Similarly, 
during time T 6l bit C 9 , C 10 and C,, are selected from the odd encoder and mapped 
according to map 0. During time period T 7 , uncoded bits B 9 , B 10 and B„ are selected 
as the output of the rate 5/6 encoder and are mapped according to map 1 . The 
chart of Figure 32 defines the types of output produced by the rate 5/6 encoder of 
Figure 20A. 

Figure 33 is a chart -defining the types of outputs produced by the 8/9th 
encoder illustrated in Figure 21A All uncoded outputs are mapped according to map 
1. All coded outputs are mapped according to map 0. During times T 0 and T 6 coded 
outputs from the even encoder are selected. During times T 3 and T 9 coded output 
from the odd encoder are selected. Accordingly, the tuple types produced by the 
rate 8/9ths encoder of Figure 21 are completely described by the illustration of 
Figure 33. 

Figure 34 is a further graphical illustration of a portion of the decoder 
illustrated in Figure 26. In Figure 34 the circular buffer 2602 is further illustrated as 
being a pair of buffers 3407 and 3409. Switches 3401 , 3403, 3405 and 3407 
operate in such a fashion as to enable the metric calculator 341 1 to receive data 
from one buffer while the other buffer is accepting data. In such a fashion one buffer 
can be used for processing input data by providing it to the metric calculator and the 
second buffer can be used for receiving data. The metric calculator 341 1 receives 
data, as required, from either buffer 3407 or buffer 3409 and calculates the distance 
between the received point and designated points of the data constellation produced 
by the source encoder. The symbol sequencer 3413 provides data to the metric 
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1 calculator 341 1 specifying the type of tuple, i.e. the constellation and bit encoding of 
the tuple, which is being decoded. The symbol sequencer also provides information 
to either buffer 3407 and 3409 regarding which data bits are to be provided to the 
metric calculator 341 1 . The symbol sequencer is generally provided information, 

5 regarding the symbol types to be received, during the initialization of the system. 

Symbol typing has been discussed previously with respect to Figures 29 through 33. 
The metric calculator 341 1 calculates the metrics for each received point. The 
metrics for a particular receive point will typically comprise 8 Euclidean distance 
squared values for each point as indicated at the output of metric calculator 341 1 . 

10 The Euclidean distance of a point is illustrated in Figure 35. 

The metric calculator 341 1 of Figure 34 has two outputs 3415 and 3417. The 
output 3415 represents eight metrics each of six bits corresponding to the Euclidian 
distance squared in the l-Q plane between a received point and all eight possible 
points of the signal constellation which represent valid received data points. Output 

15 3417 represents the mapping of an encoded bit, if any is present. The output 3417 
is an indicator of how to select the value of an uncoded bit. The value of the eight 
outputs at 3417 correspond to a 0 or 1 indicating whether the receive point is closer 
to an actual point in which the uncoded bit would assume a value of 0 or 1 . The 
method of including uncoded bits within a constellation has been well known in the 

20 art and practiced in connection with trellis coded modulation. It is included here for 
the sake of completeness. The uncoded bit metrics will be stored in FIFO 2616 until 
the corresponding points are decoded in the output processor 2618. Once the 
corresponding points are decoded in the output processor 2618, they can be 
matched with the proper value for the uncoded bit as applied by FIFO 2616. 

25 Figure 35 is a graphical illustration of the process carried on within the metric 

calculator of the decoder. In Figure 35, a constellation of designated points is 
represented in the l-Q plain by points 3503, 3505, 3507, 3509, 3511, 3513, 3515 
and 3517. The points just mentioned constitute an exemplary constellation of 
transmitted point values. In actual practice a received point may not match any of 

30 the designated transmission points of the transmitted constellation. Further a 
received point matching one of the points in the constellation illustrated may not 
coincide with the point that had actually been transmitted at the transmitter. A 
received point 3501 is illustrated for exemplary purposes in calculating Euclidean 
squared distances. Additionally, point 3519 is illustrated at the 00 point of the l-Q 

35 plain. Point 3519 is a point representing a received point having an equal probability 
of being any point in the transmitted constellation. In other words, point 3519 is a 
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1 point having an equal likelihood of having been transmitted as any constellation 
point. Point 3519 will be used in order to provide a neutral value needed by the 
decoder for values not transmitted. 

The metric calculator 341 1 calculates the distance between a receive point, for 

5 example 3501, and all transmitted points in the constellation, for example, points 

3503 and 3505. The metric calculator receives the coordinates for the receive points 
3501 in terms of 8 bits I and 8 bits Q value from which it may calculate Euclidean 
distance squared between the receive point and any constellation point. For 
example, if receive point 3501 is accepted by the metric calculator 341 1 it will 

10 calculate value X(0) and Y(0), which are the displacement in the X direction and Y 
direction of the receive point 3501 from the constellation pointer 3503. The values 
for X(0) and Y(0) can then be squared and summed and represent D 2 (0). The actual 
distance between a receive point 3501 and a point in the constellation, for example 
3503 can then be computed from the value for D 2 (0). The metric calculator however, 

15 dispenses with the calculation of the actual value of D(0) and instead employs the 
value D 2 (0) in order to save the calculation time that would be necessary to compute 
D(0) from D 2 (0). In like manner the metric calculator then computes the distance 
between the receive point and each of the individual possible points in the 
constellation i.e. 3503 through 3517. 

20 Figure 36 is a graphical illustration of the calculation of a Euclidean squared 

distance metric. Once the metric values representing the 8 metrics have been 
calculated, the metric calculator 2604 can then provide them to the SISOs 2606 and 
. 2608. 

SISOs 2606 and 2608 of Figure 34 accept the values from the metric 
25 calculator 341 1 . SISO 2606 decodes points corresponding to the odd encoder an 
SISO 2608 decodes point corresponding to the even encoder. SISOs 2606 and 
2608 operate according to a map decoding algorithm. Within each SISO is a trellis 
comprising a succession of states representing all of the states of the odd or even 
encoder. The values associated with each state represent that probability that the 
30 encoder was in that particular state during the time period associated with that 

particular state. Accordingly, SISO 2606 decodes the odd encoder trellis and SISO 
2608 decodes the even encoder trellis. Because only the odd points are accepted 
for transmission from the odd encoder SISO 2606 may contain only points 
corresponding to odd sequence designations arid SISO 2608 contains only points 
35 corresponding to even sequence designations. These are the only values supplied 
by the metric calculator because these are the only values selected for transmission. 
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Accordingly, in constructing the encoder trellis for both the odd encoder within SI SO 
2606 and the even encoder within SISO 2608 every other value is absent. Because 
a trellis can only represent a sequence of values, every other point, which is not 
supplied to each SISO must be fabricated in some manner. Because every other 
point in each of the two SISOs is an unknown point, there is no reason to presume 
that one constellation point is more likely than any other constellation point. 
Accordingly, the points not received by the SISOs from the metric calculator are 
accorded the value of the 0 point 3519. The 00 point 3519 is chosen because it is 
equidistant, i.e. equally likely, from all the possible points in the encoded 
constellation. 

Figure 37 is a representation of a portion of a trellis diagram as may be 
present in either SISO 2606 or SISO 2608. The diagram illustrates a calculation of 
the likelihood of being in state M 3701. The likelihood of being in state M, 3701 is 
calculated in two different ways. The likelihood of being in state M 3701 at time k is 
proportional to the likelihood that a time K-1 that the encoder was in a state in which 
the next successive state could be state M (times the likelihood that the transmission 
was made into state M). In the trellis diagram state M may be entered from 
precursor states 3703, 3705, 3707 or 3709. Therefore, the likelihood of being in 
state M 3701 is equal to the likelihood of being in state 3701 , which state 0 of the 
encoder, and is symbolized by a K (0). 

The likelihood of being in state M 3701 may be evaluated using previous and 
future states. For example, if state M 3701 is such that it may be entered only from 
states 3703, 3705, 3707 or 3709, then the likelihood of being in state M 3701 is 
equal to the summation of the likelihoods that it was in state 3703 and made a 
transition to state 3701 , plus the likelihood that the decoder was in state 3705 and 
made the transition to state 3701, plus the likelihood that the decoder was in state 
3707 and made the transition to state 3701 , plus the likelihood that the decoder was 
in state 3709 and made the transition to state 3701. 

The likelihood of being in state M 3701 at time k may also be analyzed from 
the viewpoint of time k+1. That is, if state M 3701 can transition to state 3711, state 
3713, state 3715, or state 3717, then the likelihood that the decoder was in state M 
3701 at time k is equal to a sum of likelihoods. That sum of likelihoods is equal to 
the likelihood that the decoder is in state 371 1 at time k+1 and made the transition 
from state 3701 , plus the likelihood that the decoder is in state 371 3 at time k+1 , 
times the likelihood that it made the transition from state M 3701, plus the likelihood 
that it is in state 3715 and made the transition from state 3701, plus the likelihood 
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1 that it is in state 3717 and made the transition from state M 3701 . In other words, 

the likelihood of being in a state M is equal to the sum of likelihoods that the decoder 
was in a state that could transition into state M, times the probability that it made the 
transition from the precursor state to state M t summed over all possible precursor 

5 states. 

The likelihood of being in state M can also be evaluated from a post-cursor 
state. That is, looking backwards in time. To look backwards in time, the likelihood 
that the decoder was in state M at time k is equal to the likelihood that it was in a 
post-cursor state at time k+1 times the transition probability that the decoder made 

10 the transition from state M to the post-cursor state, summed over all the possible 
post-cursor states. In this way, the likelihood of being in a decoder state is 
commonly evaluated both from a past and future state. Although it may seem 
counter-intuitive that a present state can be evaluated from a future state, the 
problem is really semantic only. The decoder decodes a block of data in which 

15 each state, with the exception of the first time period in the block of data and the last 
time period in the block of data, has a precursor state and a post-cursor state 
represented. That is, the SISO contains a block of data in which all possible 
encoder states are represented over TP time periods, where TP is generally the 
length of the decoder block. The ability to approach the probability of being in a 

20 particular state by proceeding in both directions within the block of data is commonly 
a characteristic of map decoding. 

The exemplary trellis depicted in Figure 37 is an eight state trellis representing 
the eight possible encoder states. Additionally, there are a maximum of four paths 
into or out of any state, because the constituent encoders which created the trellis in 

25 Figure 37 had 2-bit inputs. Such a constituent encoder is illustrated in Figure 5. In 
fact, Figure 37 is merely an abbreviated version of the trellis of the right two-thirds 
constituent encoder illustrated in Figure 6, with an additional time period added. 

The state likelihoods, when evaluating likelihoods in the forward direction, are 
termed the "forward state metric" and are represented by the Greek letter alpha (a). 

30 The state likelihoods, when evaluating the likelihood of being in a particular state 

when evaluated in the reverse direction, are given the designation of the Greek letter 
beta (p). In other words, forward state metric is generally referred to as a, and the 
reverse state metric is generally referred to as p. 

Figure 38 is a generalized illustration of a forward state metric alpha (a) and a 

35 reverse state metric beta (p). The likelihood of being in state 3808 at time k is 

designated as a k . a k designates the forward state metric alpha at time k for a given 
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1 state. Therefore, a k for state 3808 is the likelihood that the encoder was in a trellis 
state equivalent to state 3808 at time k. Similarly, at time k-1, the likelihood that the 
encoder was in a state equivalent to state 3801 at time a k ., is designated as a M 
(3801). The likelihood that the encoder was in state 3809 at time k-1 is equal to a M 

5 (3809). Similarly, at time k-1 , the likelihood that the encoder was in state 3818 at 
time k-1 is equal to a M (3813). Similarly, the likelihood that the encoder was in a 
state equivalent to state 3817 at time k-1 is equal to a M (3817). Therefore, to 
compute the likelihood that the encoder is in state 3803, the likelihood of being in a 
precursor state must be multiplied by the likelihood of making the transition from a 

10 precursor state into state 3803. 

The input at the encoder that causes a transition from a state 3801 to 3803 is 
an input of 0,0. The likelihood of transition between state 3801 and state 3803 is 
designated as 6(0,0) (i.e. delta (0,0)). Similarly, the transition from state 3809 to 
3803 represents an input of 0,1, the likelihood of transition between state 3809 and 

15 state 3803 is represented by delta (0,1). Similarly, the likelihood of transition 
between state 3813 and 3803 is represented by delta (1,0) as a 1,0 must be 
received by the encoder in state 3813 to make the transition to state 3803. Similarly, 
a transition from state 3817 to state 3803 can be accomplished upon the encoder 
receiving a 1,1, and therefore the transition between state 3817 and state 3803 is 

20 the likelihood of that transition, i.e. 5(1 ,1 ). Accordingly, the transition from state 

3801 to 3803 is labeled 5,(0,0) indicating that this is a first transition probability and it 
is the transition probability represented by an input of 0,0. Similarly, the transition 
likelihood between state 3809 and 3803 is represented by 6 2 (0,1), the transition 
between state 3313 and state 3803 is represented by 5 3 (1,0), and the likelihood of 

25 transition between state 3817 and 3803 is represented by 6 4 (1,1). 

The situation is similar in the case of the reverse state metric, beta (B). The 
likelihood of being in state 3807 at time k+1 is designated B k+1 (3807). Similarly, the 
likelihood of being in reverse metric states 381 1 , 3815, 3819 and 3805 are equal to 
B k+1 (3811), B k+1 (3815), B k+1 (3819), and M3805). Likewise, the probability of 

30 transition between state 3805 and 3807 is equal to 5, (0,0), the likelihood of 
transition between state 3805 and 381 1 is equal to 5 5 (0,1). The likelihood of 
transition from state 3805 to 3815 is equal to 5 6 (1,0), and the likelihood of transition 
between state 3805 and 3819 is equal to 6 7 (1,1). In the exemplary illustrated of 
Figure 38, there are four ways of transitioning into or out of a state. The transitions 

35 are determined by the inputs to the encoder responsible for those transitions. In 

other words, the encoder must receive a minimum of two bits to decide between four 
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different possible transitions. By evaluating transitions between states in terms of 2- 
bits inputs to the encoder at a given time, somewhat better performance can be 
realized than by evaluating the decoding in terms of a single bit at a time. This result 
may seem counter-intuitive, as it might be thought that evaluating a trellis in terms of 
a single bit, or in terms of multiple bits, would be equivalent. However, by evaluating 
the transitions in terms of how the input is provided at a given time, a somewhat 
better performance is obtained because the decoding inherently makes use of the 
noise correlation which exists between two, or more, simultaneous input bits. 

Accordingly, the likelihood of being in state 3803 may be represented by 
expression 1. 

a k (3701) = 

a w (3703) x 6, (0,0) + a w (3705) x 6 2 (0,1) + 

a M (3707) x 6 3 (1,0) + a w (3709) x 6 4 (1,1). (Expr.1) 

Similarly, 0 k can be represented by expression 2: 

0 k (3701) = 5, (0,0) x (3 k+1 (371 1) + 5 5 (0,1) 
x p k+1 (3713) + 5 6 (1,0) x p k+1 (3715) + 5 7 (1,1) 

x IV, (3717). (Expr.2) 

Figure 39A is a block diagram further illustrating the parallel SISOs illustrated 
in Figure 26. Both SISOs, 2606 and 2608, accept channel metrics 3905, which are 
provided by the metric calculator 2604. SISO 2606 decodes the trellis 
corresponding to the encoding of the odd encoder. SISO 2608 decodes the trellis 
corresponding to the even encoder. The even and odd encoders may be, for 
example, the even and odd encoders illustrated in Figures 17 through 21. SISO 
2606 will accept channel metrics corresponding to even encoded tuples and SISO 
2608 will accept channel metrics corresponding to odd tuples. SISO 2606 assigns 
the zero point, i.e., the point with equally likely probability of being any of the 
transmitted points, as a metric for all the even points in its trellis. Similarly, SISO 
2608 assigns the 0,0 point, a point equally likely to be any constellation point, to all 
odd points in its trellis. The extrinsic values 3909 computed by SISO 2606 become 
the A Priori values 3913 for SISO 2608. Similarly, the extrinsic values 3915, 
computed by SISO 2608, become the A Priori values 3907 for SISO 2606. After a 
final iteration, SISO 2606 will provide A Posteriori values 391 1 to the output 
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1 processor 2618. Similarly, SISO 2608 will provide A Posteriori values 3917 to the 
output processor 2618. The SISO pair of Figure 39A comprise an even/odd, or 
moduIo-2 decoder. As indicated earlier, neither the encoding nor the decoding 
systems disclosed herein, are limited to even and odd (modulo 2) implementations 

5 and may be extended to any size desired. To accommodate such modulo-N 

systems, additional SISOs may be added. Such systems may achieve even greater 
parallelism then can systems employing only 1 SISO. 

Figure 39B is a block diagram of a modulo-N type decoder. A modulo-N 
decoder is one having N SISOs. A modulo-N decoder can provide parallel decoding 

10 for parallel encoded data streams, as previously discussed. Parallel decoding 
systems can provide more estimates of the points being decoded in the same 
amount of time as non-parallel type systems take. In Figure 39B, channel metrics 
3951 are provided to end SISOs 3957, 3965, 3973, and 3983. SISO 3973 may 
represent multiple SISOs. Such a modulo-N decoding system may have any 

15 number of SISOs desired. If a modulo-N encoding system is paired with a modulo-N 
decoding system, as disclosed herein, the decoding can take place in parallel, and 
may provide superior decoding for the same amount of time that a serial decoder 
would use. SISO 3957 computes an extrinsic value 3955, which becomes the 
A Priori value 3961 for SISO 3965. SISO 3965 computes an extrinsic value 3963, 

20 and then provides it as an A Priori value 3969 to SISO chain 3973. SISOs 3973 
may comprise any number of SISOs configured similarly to SISO 3965. The final 
SISO in the SISO chain 3973 provides an extrinsic value 3971 , which becomes an 
A Priori value 3977 for SISO 3983. The extrinsic value 3979, computed by SISO 
3983, can provide an A Priori value 3953 for SISO 3957. Each SISO then can 

25 provide A Posteriori values, i.e., 3959, 3967, 3981 , and the series of A Posteriori 
values 3975, to an output processor such as illustrated at 2718. 

Figure 40 is a block diagram illustrating the workings of a SISO such as that 
illustrated at 2606, 3957, 2606 or 2701 . The inputs to the SISO 4000 comprise the 
channel metrics 4001 and the A Priori values 4003. Both the A Priori value 4003 

30 and the channel metrics 4001 are accepted by the alpha computer 4007. The 
A Priori values and channel metrics are also accepted by a latency block 4005, 
which provides the delays necessary for the proper internal synchronization of the 
SISO 4000. The alpha computer 4007 computes alpha values and pushes them on, 
and pops them from, a stack 4017. The output of the alpha computer also is 

35 provided to a dual stack 4009. 

Latency block 4005 allows the SISO 4000 to match the latency through the 
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1 alpha computer 4007. The dual stack 4009 serves to receive values from the 

latency block 4005 and the alpha computer 4007. While one of the dual stacks is 
receiving the values from the alpha computer and the latency block, the other of the 
dual stacks is providing values to the Ex. Beta values are computed in beta 

5 computer 401 1 , latency block 4013 matches the latency caused by the beta 

computer 401 1 , the alpha to beta values are then combined in metric calculator 
block 4015, which provides the extrinsic values 4017, to be used by other SISOs as 
A Priori values. In the last reiteration, the extrinsic values 4017 plus the A Priori 
values will provide the A Posteriori values for the output processor. 

10 SISO 4000 may be used as a part of a system to decode various size data 

blocks. In one exemplary embodiment, a block of approximately 10,000 2-bit tuples 
is decoded. As can be readily seen, in order to compute a block of 10,000 2-bit 
tuples, a significant amount of memory may be used in storing the a values, 
retention of such large amounts of data can make the cost of a system prohibitive. 

15 Accordingly, techniques for minimizing the amount of memory required by the 
SISO's computation can provide significant memory savings. 

A first memory savings can be realized by retaining the I and Q values of the 
incoming constellation points within the circular buffer 2602. The metrics of those 
points are then calculated by the metric calculator 2604, as needed. If the metrics of 

20 the points retained in the circular buffer 2602 were all calculated beforehand, each 
point would comprise eight metrics, representing the Euclidian distance squared 
between the received point and all eight possible constellation points. That would 
mean that each point in circular buffer 2602 would translate into eight metric values, 
thereby requiring over 80,000 memory slots capable of holding Euclidian squared 

25 values of the metrics calculated. Such values might comprise six bits or more. If 

each metric value comprises six bits, then six bits times 10,000 symbols, times eight 
metrics per symbol, would result in nearly one-half megabit of RAM being required to 
store the calculated metric values. By calculating metrics as needed, a considerable 
amount of memory can be saved. One difficulty with this approach, however, is that 

30 in a system of the type disclosed, that is, one capable of processing multiple types of 
encodings, the metric calculator must know the type of symbol being calculated in 
order to perform a correct calculation. This problem is solved by the symbol 
sequencer 3413 illustrated in Figure 34. 

The symbol sequencer 3413 provides to the metric calculator 341 1 , and to the 

35 input buffers 3407 and 3409, information regarding the type of encoded tuple 
received in order that the metric calculator and buffers 3407 and 3409 may 
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cooperate and properly calculate the metrics of the incoming data. Such input tuple 
typing is illustrated in Figures 29 through 33, and has been discussed previously. 

Figure 41 is a graphical representation of the processing of alpha values within 
a SISO such as illustrated at 2606, 4000 or 2606. One common method for 
processing alpha values is to compute all the alpha values in a block. Then the final 
alpha values can be used with the initial beta values in order to calculate the state 
metrics. If the block of data that is being processed is large, such as the exemplary 
10,000 two-bit tuple block exemplarily calculated in SISO 4000, then a significant 
amount of memory must be allotted for storing the alpha values computed. An 
alternate method of processing alpha values is employed by the SISO unit 4000. In 
order to save memory, all the alpha values are not stored. The a value data matrix 
within the SISO is divided into a number of sub-blocks. Because the sub-block size 
may not divide equally into the data block size, the first sub-block may be smaller 
than all of the succeeding sub-blocks which are equally sized. In the example 
illustrated in Figure 41, the sub-block size is 125 elements. The first sub-block 
numbered a 0 through a 100 is selected as having 101 elements in order that all the 
other sub-blocks may be of equal size, that is 125 elements. The alpha computer 
successively computes alpha values, a 0, a 1 , etc. in succession. The alpha values 
are not all retained but are merely used to compute the successive alpha values. 
Periodically an a value is pushed on a stack 4103. So, for example, a value, a 100, 
is pushed on stack 4103 as a kind of a checkpoint. Thereafter, another 125 a values 
are computed and not retained. The next alpha value (alpha 225) is pushed on 
stack 4103. This process continues in succession with every 126 th value being 
pushed on stack 4103 until a point is reached in which the alpha computed is one 
sub-block size away from the end of the data block contained within the SISO. So, 
for example, in the present case illustrated in Figure 42, the point is reached in a 
block of size N when a (N-125) is reached, i.e. 125 a values from the end of the 
block. When the beginning of this final sub-block within the SISO is encountered, all 
alpha values are pushed on a second stack 4009. The stack 4009 will then contain 
all alpha values of the last sub-block. This situation is illustrated further in Figure 42. 

Figure 42 is a graphical illustration of the alpha processing within the SISO 
4000. The alpha values are processed in sub-blocks of data. For the purposes of 
illustration, a sub-block of data is taken to be 126 alpha values.. A sub-block, 
however, may be of various sizes depending on the constraints of the particular 
implementation desired. The alpha block of data is illustrated at 4200 in Figure 42. 
The first step in processing the alpha block 4200 is to begin at the end of block 
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1 4215 and divide the block 4200 into sub-blocks. Sub-blocks 4219, 4221 and 4223 
are illustrated in Figure 42. Once the block 4200 has been divided into sub-blocks 
marked by checkpoint values 4209, 4207, 4205, 4203 and 4201, the processing 
may begin. Alpha computer 4007 begins calculating alpha values at the beginning 

5 of the block, designated by 4217. Alpha values are computed successively and 
discarded until alpha value 4209, i.e., a checkpoint value, is computed. The 
checkpoint value 4209 is then pushed on stack 4019. Alpha computer 4007 then 
continues to compute alpha values until checkpoint value 4207 is reached. Once 
checkpoint value 4207 is reached, it is pushed on stack 4019. The distance 

10 between checkpoint value 4209 and checkpoint value 4207 is 125 values, i.e., one 
sub-block. Similarly, alpha values are computed from 4207 to 4205 and discarded. 
Checkpoint value 4205 is then pushed on stack 401 9 and the process continues. 
The alpha computer then computes alpha values and continues to discard them 
until checkpoint value 4203 is reached. At which point, checkpoint value 4203 is 

15 pushed on the stack 4019. The alpha computer once again begins computing 
alpha values starting with alpha value 4203 until, 125 alpha values have been 
computed and the beginning of sub-block 4219 is reached. Sub-block 4219 is the 
final sub-block. The alpha computer 4007 computes alpha values for sub-block 
4219 pushing every alpha value on stack A 4009. Because sub-block 4219 

20 contains 125 elements, once the alpha computer has computed all of sub-block 
4219, stack A will contain 125 alpha values. Once the alpha values for sub-block 
4219 have been computed, the alpha computer will then pop value 4203 off stack 
4019 and begin to compute each and every value for sub-block 4221. Values for 
sub-block 4221 are pushed on stack B 4009. While the values for sub-block 4221 

25 are being pushed on stack B 4009, the previous values which had been pushed on 
stack A 4009 are being popped from the stack. Beta values 421 1 , which are 
computed in the opposite direction of the alpha values, are computed beginning 
with the end of block 4200 marked at 4215. The beta values 421 1 are combined 
with the alpha values, as they are popped from stack A 4009, in the extrinsic 

30 calculator 401 5. The beta values 421 1 and the alpha values from stack A 4009 are 
combined until the last alpha element has been popped from stack A 4009. Once 
stack A 4009 has been emptied, it may once again begin receiving alpha values. 
Checkpoint alpha value 4205 is popped from stack 4019 and used as a starting 
value for the alpha computer 4007. The alpha computer may then compute the 

35 alpha values for sub-block 4223 are pushed onto the just emptied stack A 4009. 

While the alpha values are being computed and pushed on stack A 4009, the alpha 
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values are being popped from stack B 4009 and combined with beta values 4213 in 
extrinsic calculator 401 5. 

In the manner just described, the SISO computes blocks of data one sub- 
block at a time. Computing blocks of data one sub-block at a time limits the 
amount of memory that must be used by the SISO. Instead of having to store an 
entire block of alpha values within the SISO for the computation, only the sub-block 
values and checkpoint values are stored. Additionally, by providing two stacks 
4009 A and B, one sub-block can be processed while another sub-block is being 
computed. 

Figure 43 is a block diagram further illustrating the read-write architecture of 
the interleaver and deinterleaver of the decoder as illustrated in Figure 26. The 
interleaver and deinterleaver are essentially combined utilizing eight RAM blocks 
4303, 4305, 4307, 4309, 4311, 4313, 4315, and 4317. The addressing of the eight 
RAMs is controlled by a central address generator 4301. The address generator 
essentially produces eight streams of addresses, one for each RAM. Each 
interleaver and deinterleaver takes two sets of values and also produces two sets 
of values. There are eight RAM blocks because each input tuple data point, 
comprising two bits, has each bit interleaved and deinterleaved separately. As the 
alpha and beta computations are being performed in the SISOs, the a priori 
information is being read from an interleaver and deinterleaver. While the 
information is being read from an interleaver and deinterleaver, an iteration 
computation is proceeding and values are being written to the interleavers and 
deinterieavers. Therefore, at any time point, four separate RAMs may be in the 
process of being written to, and four separate RAMs may be in the process of 
being read. The generation of address sequences for the 
interleaver/deinterleavers of the SISO system is somewhat complex. 

Figure 44 is a graphical illustration illustrating the generation of decoder 
sequences for the interleaver/deinterleaver addressing illustrated in Figure 43. 
Since the decoder sequences are somewhat long, and may be greater than 10,000 
addresses in length, short examples are used to illustrate the principles involved. A 
portion of the memory of address generator 4301 is illustrated at 4415. Within the 
memory 4415, an interleave sequence is stored. The interleave sequence is stored 
as illustrated by arrows 4401 and 4403. That is, the interleave sequence is stored 
in a first direction, then in a second direction. In such a manner, address 0, 
illustrated at 4417 stores the interleave position for the first and last words of the 
interleave sequence. The next memory location, after 4417 will store the interleave 
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position for the second and the second to last words in the block, and so forth. The 
storage of sequences is done in this manner the interleave and deinterleave 
sequences for encoded bit 1 is the time reversal of the interleave sequence for 
encoded bit 0. In such a way, interleave sequences for the two information bits 
which are st interleaved may be stored with no increased storage requirement over 
a sequence being stored for just one of the bits, i.e. a system in which the two 
information bits are it interleaved. In such a manner, a sequence for a bit 
interleaver can be achieved using the same amount of data to store that sequence 
as would be the case for a two-bit it interleaver. The interleaving/deinterleaving 
sequence for one of the two information bits is the time reversal of the 
interleaving/deinterleaving sequence for the other information bit. For the practical 
purposes of interleaving and deinterleaving, the sequences thus generated are 
effectively independent. 

A second constraint that the interleave sequence has is that odd positions 
interleave to odd positions and even positions interleave to even positions in order 
to correspond to the encoding method described previously. The even and odd 
sequences are used byway of illustration. The method being described can be 
extended to a modulo N-type sequence where N is whatever integer value desired. 
It is also desirable to produce both the sequence and the inverse sequence without 
having the requirement of storing both. The basic method of generating both the 
sequence and the inverse sequence is to use a sequence in a first case to write in 
a permuted manner to RAM according to the sequence, and in the second case to 
read from RAM in a permuted manner according to the sequence. In other words, 
in one case the values are written sequentially and read in a permuted manner, 
and in the second case they are written in a permuted manner and read 
sequentially. This method is briefly illustrated in the following. For a more thorough 
discussion, refer to the previous encoder discussion. In other words, an address 
stream for the interleaving and deinterleaving sequence of Figure 43 can be 
produced through the expedient of writing received data sequentially and then 
reading it according to a permuted sequence, as well as writing data according to a 
permuted sequence and then reading it sequentially. Additionally, even addresses 
must be written to even addresses and odd addresses must be written to odd 
addresses in the example decoder illustrated. Of course, as stated previously, this 
even odd, modulo 2, scheme may be extended to any modulo level. 

As further illustration, consider the sequence of elements A, B, C, D, E, and 
F 4409. Sequence 4409 is merely a permutation of a sequence of addresses 0, 1 , 
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1 2, 3, 4, and 5, and so forth, that is, sequence 4411. It has been previously shown 
that sequences may be generated wherein even positions interleave to even 
positions and odd positions interleave to odd positions. Furthermore, it has been 
shown that modulo interleaving sequences, where a modulo N position will always 

5 interleave to a position having the same modulo N, can be generated. Another way 
to generate such sequences is to treat the even sequence as a completely 
separate sequence from the odd sequence and to generate interleaving addresses 
for the odd and even sequences accordingly. By separating the sequences, it is 
assured that an even address is never mapped to an odd address or vice-versa. 

10 This methodology can be applied to modulo N sequences in which each sequence 
of the modulo N sequence is generated separately. By generating the sequences 
separately, no writing to or reading from incorrect addresses will be encountered. 

In the present example, the odd interleaver sequence is the inverse 
permutation of the sequence used to interleave the even sequence. In other 

15 words, the interleave sequence for the even positions would be the deinterleave 

sequence for the odd positions and the deinterleave sequence for the odd positions 
will be the interleave sequence for the even positions. By doing so, the odd 
sequence and even sequence generate a code have the same distant properties. 
Furthermore, generating a good odd sequence automatically guarantees the 

20 generation of a good even sequence derived from the odd sequence. So, for 

example, examining the write address for one of the channels of the sequence as 
illustrated in 4405. The sequence 4405 is formed from sequences 4409 and 441 1 . 
Sequence 4409 is a permutation of sequence 4411, which is obviously a sequential 
sequence. Sequence 4405 would then represent the write addresses for a given 

25 bit lane (the bits are interleaved separately, thus resulting in two separate bit 

lanes). The inverse sequence 4407 would then represent the read addresses. The 
interleave sequence for the odd positions is the inverse of the interleave sequence 
for the odd positions. So while positions A, B, C, D, E and F are written to, 
positions 0, 1 , 2, 3, 4, and 5 would be read from. Therefore, if it is not desired to 

30 write the even and odd sequence to separate RAMs, sequences 4405 and 4407 
may each be multiplied by 2 and have a 1 added to every other position. This 
procedure of ensuring that the odd position addresses specify only odd position 
addresses and even position addresses interleave to only even position addresses 
is the same as discussed with respect to the encoder. The decoder may proceed 

35 on exactly the same basis as the encoder with respect to interleaving to odd and 
even positions. All comments regarding methodologies for creating sequences of 
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1 interleaving apply to both the encoder and decoder. Both the encoder and decoder 
can use odd and even or modulo N interleaving, depending on the application 
desired. If the interleaver is according to table 441 3 with the write addresses 
represented by sequence 4405 and the read addresses represented by 4407, then 

5 the deinterleaver would be the same table 441 3 with the write addresses 

represented by sequence 4407 and the read addresses represented by sequence 
4405. Further interleave and deinterleave sequences can be generated by time 
reversing sequences 4405 and 4407. This is shown in table 4419. That is, the 
second bit may have an interleaving sequence corresponding to a write address 

10 represented by sequence 4421 of table 4419 and a read address of 4422. The 
deinterleaver corresponding to a write sequence of 4421 and a read sequence of 
4422 will be a read sequence of 4422 and a write sequence of 4421. 

Figure 45 is a graphical illustration of a decoder trellis according to an 
embodiment of the invention. A decoder trellis, in general, represents possible 

15 states of the encoder, the likelihood of being in individual states, and the transitions 
which may occur between states. In Figure 45, the encoder represented is a turbo 
trellis coded modulation encoder having odd even interleaving and constituent 
encoders as illustrated in Figure 5. In Figure 45, a transition into state 0 at time 
equal to k+1 is illustrated. The likelihood that the encoder is in state 0 at time k+1 

20 is proportional to a k+1 (0), i.e., state 451 1 . To end up in state 451 1 , at time k+1 , the 
encoder had to be in state 0, state 1 , state 2, or state 3 at time k. This is so 
because, as illustrated in Figure 45, the precursor state for state 451 1 is stated 
4503, 4505, 4507 or 4509 only. These transitions are in accordance with the trellis 
diagram of Figure 6. Accordingly, the enter state 451 1 at time k+1 , the encoder 

25 must be in state 4503 and transit along path number 1 , or the encoder may be in 
state 4505 and transition along path 2 into state 451 1 , or the encoder may be in 
state 4507 and transit along path 3 to state 451 1 , or the encoder may be in state 
4509 and transit into state 451 1 . If the encoder is in state 4503, that is, state 0, at 
time k and the encoder receives an input of 00, it will transition along path 1 and 

30 provide an output of 000 as indicated in Figure 45. If the encoder is in state 1 at 
time k, that is, state 4505, and the encoder receives an input of 10, it will transition 
according to path 2 and output a value of 101. If the encoder is in state 2, 
corresponding to state 4507 at time k, and the encoder receives an input of 1 1 , 
then the encoder will transition along path 3 into state 451 1 , outputting a 1 1 0. If 

35 the encoder is in state 3, corresponding to state 4509 at time k, and the encoder 
received an input of a 01 , then the encoder will transition along path 4 into state 



-63- 



WO 02/23738 



PCT/US01/28875 



1 4511 and output a 011. 

Therefore, to find the likelihood that the encoder is in state 0, i.e., 451 1 , at 
time k+1, it is necessary to consider the likelihood that the encoder was in a 
precursor state, that is, state 0-3, and made the transition into state 0 at time k+1 . 

S Likelihoods within the decoder system are based upon the Euclidian distance 

mean squared between a receive point and a possible transmitted constellation 
point, as illustrated and discussed with reference to Figure 35. The likelihood 
metrics used in the illustrative decoder (for example, as drawn in Figure 26) are 
inversely proportional to the probability that a received point is equal to a 

10 constellation point. To illustrate the likelihood function, consider point 3501 of 
Figure 35. Point 3501 represents a received signal value in the l-Q plane. 
Received point 3501 does not correspond to any point in the transmitted 
constellation, that is, point 3503 through point 3517. Received point 3501 may in 
have been transmitted as any of the points 3503 through 3517. The likelihood that 

15 the received point 3501 is actually point 3503 is equal to the Euclidian squared 

distance between received point 3501 and point 3503. Similarly, the likelihood that 
received point 3501 is any of the other points within Figure 35 is equal to the 
distance between the received point 3501 and the candidate point squared. In 
other words, the metric representing the likelihood that received point 3501 is equal 

20 to a constellation point is proportional to the distance squared between the 

received point and any constellation point. Thus, the higher value for the metric, 
representing the distance between the received point and the constellation point, 
the less likely that the received point was transmitted as the constellation point. In 
other words, if the distance squared between the received point is 0, then it is 

25 highly likely that the received point and the constellation point are the same point. 
NOTE: Even though the received point may coincide with one constellation point, it 
may have been in fact transmitted as another constellation point, and accordingly 
there is always a likelihood that the received point corresponds to each of the 
points within the constellation. In other words, no matter where received point 3501 

30 is located in the l-Q plane, there is some finite likelihood that point 3503 was 

transmitted, there is some finite likelihood that point 3505 was transmitted, there is 
some finite likelihood that point 3507 was transmitted, and so forth. Because the 
map decoder illustrated in the present disclosure is a probabilistic decoder, all the 
points within a decoding trellis, such as illustrated at 45, have some likelihood. An 

35 iterative decoder generally assigns likelihoods to each of the given points and only 
in the last iteration are the likelihood values, that is, soft values, turned into hard 
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1 values of 1 or 0. Probabilistic decoders in general make successive estimates of 
the points received and iteratively refine the estimates. Although there are many 
different ways of representing the probability or likelihood of points, for example 
Hamming distances, the decoder of the present embodiment uses the Euclidian 

5 distance squared. The Min* operation is described and illustrated later in this 
disclosure. 

Because the Euclidean distance squared is used as the likelihood metric in 
the present embodiment of the decoder the higher value for the likelihood metrics 
indicate a lower probability that the received point is the constellation point being 

10 computed. That is, if the metric of a received point is zero then the received point 
actually coincides with a constellation point and thus has a high probability of being 
the constellation point. If, on the other hand, the metric is a high value then the 
distance between the constellation point and the received point is larger and the 
likelihood that the constellation point is equal to the received point is lower. Thus, 

15 in the present disclosure the term "likelihood" is used in most cases. The term 
"likelihood" as used herein means that the lower value for the likelihood indicates 
that the point is more probably equal to a constellation point. Put simply within the 
present disclosure "likelihood" is inversely proportional to probability, although 
methods herein can be applied regardless if probability or likelihood is used. 

20 In order to decide the likelihood that the encoder ended up in state 451 1 (i.e. 

state 0) at time k+1 , the likelihood of being in state 0-3 must be considered and 
must be multiplied by the likelihood of making the transition from the precursor 
state into state 451 1 and multiplied by the a priori probability of the input bits. 
Although there is a finite likelihood that an encoder in state 0 came from state 0. 

25 There is also a finite likelihood that the encoder in state 0 had been in state 1 as a 
precursor state. There is also a finite likelihood that the encoder had been in state 
2 as a precursor state to state 0. There is also a finite likelihood that the encoder 
had been in state 3 as a precursor state to state 0. Therefore, the likelihood of 
being in any given state is a product with a likelihood of a precursor state and the 

30 likelihood of a transition from that precursor state summed over all precursor 

states. In the present embodiment there are four events which may lead to state 
451 1 . In order to more clearly convey the method of processing the four events 
which may lead to state 451 1 (i.e. state 0) will be given the abbreviations A, B, C 
and D. Event A is the likelihood of being in state 4503 times the likelihood of 

35 making the transition from state 4503 to 451 1 . This event can be expressed as 

a k (0) x 5 k (00) x the a priori probability that the input is equal to 00. a k (0) is equal to 
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1 the likelihood of being in state 0 at time k. 5^00) is the likelihood, or metric, of 

receiving an input of 00 causing the transition from a k (0) to a k+1 (0). In like manner 
Event B is the likelihood of being in state 4505 times the likelihood of making the 
transition from state 4505 to state 451 1 . In other words, a k (1) x 5 k (10) x the a priori 

5 probability that the input is equal to 1 0. Event C is that the encoder was in state 

4507 at time = k and made the transition to state 451 1 at time = k+1 . Similarly, this 
can be stated a k (2) * 5 k (1 1) x the a priori probability that the input is equal to 1 1 . 
Event D is that the encoder was in state 4509 and made the transition into state 
451 1 . In other words, ct k (3) * 5 k (01) x the a priori probability that the input is equal 

10 to 01. 

The probability of being in any given state therefore, which has been 
abbreviated by alpha, is the sum of likelihoods of being in a precursor state times 
the likelihood of transition to the given state and the a priori probability of the input 
In general, probabilistic decoders function by adding multiplied likelihoods. 

15 The multiplication of probabilities is very expensive both in terms of time 

consumed and circuitry used as when considered with respect to the operation of 
addition. Therefore, it is desirable to substitute for the multiplication of likelihoods 
or probabilities the addition of the logarithm of the probabilities or likelihoods which 
is an equivalent operation to multiplication. Therefore, probabilistic decoders, in 

20 which multiplications are common operations, ordinarily employ the addition of 
logarithms of numbers instead of the multiplications of those numbers. 

The probability of being in any given state such as 451 1 is equal to the sum 
probabilities of the precursor states times the probability of transition from the 
precursor states into the present state times the a prior probability of the inputs. As 

25 discussed previously, event A is the likelihood of being in state 0 and making the 
transition to state 0. B is the event probability equivalent to being in state 1 and 
making the transition to state 0. Event C is the likelihood of being in state 2 and 
making the transition to state 0. Event D is the likelihood of being in state 3 and 
making the transition into state 0. To determine the likelihood of all the states at 

30 time k+1 transitions must be evaluated. That is there are 32 possible transitions 
from precursor states into the current states. As stated previously, the likelihoods 
or probabilities of being in states and of having effecting certain transitions are all 
kept within the decoder in logarithmic form in order to speed the decoding by 
performing addition instead of multiplication. This however leads to some difficulty 

35 in estimating the probability of being in a given state because the probability of 

being in a given state is equal to the sum of events A+B+C+D as previously stated. 
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1 Ordinarily these probabilities of likelihoods would be simply added. This is not 

possible owing to the fact that the probability or likelihoods within the decoder are in 
logarithmic form. One solution to this problem is to convert the likelihoods or 
probabilities from logarithmic values into ordinary values, add them, and then 

5 convert back into a logarithmic values. As might be surmised this operation can be 
time consuming and complex. Instead an operation of Min* is used. The Min* is a 
variation of the more common operation of Max*. The operation of Max* is known 
in the art. Min* is an identity similar to the Max* operation but is one which may be 
performed in the present case on log likelihood values. The Min* operation is as 

10 follows. 

Min* (A,B) = Min (A,B) - Ln (1+e" 18 - 61 ) 

The Min* operation can therefore be used to find the sum of likelihoods of 

15 values which are in logarithmic form. 

Finally, the likelihood of being in state 4511 is equal to the Min* (A,B,C,D). 
Unfortunately, however, Min* operation can only take 2 operands for its inputs. 
Two operands would be sufficient if the decoder being illustrated was a bit decoder 
in which there were only two precursor states for any present state. The present 

20 decoder is of a type of decoder, generally referred to as a symbol decoder, in which 
the likelihoods are evaluated not on the basis of individual bits input to the encoder, 
but on the basis of a combination, in this case pairs, of bits. Studies have shown 
that the decoding is slightly improved in the present case when the decoder is 
operated as a symbol decoder over when the decoder is operated as a bit decoder. 

25 In reality the decoder as described is a hybrid combination symbol and bit decoder. 
Figure 46A is a graphical illustration of a method for applying the Min* 
operatibn to four different values. The configuration of Figure 46A illustrates a 
block diagram of a method for performing a Min* operation on four separate 
values, A, B, C and D. As indicated in Figure 46A a timing goal of the operation in 

30 one particular embodiment is to be able to perform a Min* operation on four 
operands within five nanoseconds. 

Figure 46B is a graphical illustration further illustrating the use of the Min* 
operation. The Min* operation (pronounced Min star) is a two operand operation, 
meaning that it is most conveniently implemented as a block of circuitry having 2 

35 input operands. In order to perform a Min* operation on more than two operations 
it is convenient to construct a Min star structure. A Min* structure is a cascade of 
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1 two input Min* circuits such that ail of the operands over which the Min* operation is 
to be performed enter the structure at one point only. The structure will have only 
one output which is the Min* performed over all the operands, written Min*(operand 
1 , operand 2 ... operand N), where N is the number of operands. Min* structures 

5 may be constructed in a variety of ways. For example a Min* operation performed 
over operands A, B, C and D may appear as shown at 461 1, 4613, or in several 
other configurations. Any Min* structure will provide the correct answer over the 
operands, but as illustrated in Figure 46A Min* structures may have different 
amounts of propagation delay depending on how the two operand Min* blocks are 

10 arranged. In an illustrative embodiment the Min* structure 461 1 can meet a 
maximum delay specification of 5 nanoseconds, while the Min* structure 4613 
cannot. This is so because structure 461 1 is what is known as a "parallel" 
structure. In a parallel Min* structure the operands enter the structure as early as 
possible. In a parallel structure the overall propagation delay through the structure 

15 is minimized. 

Figure 46B the Min* configuration of Figure 46A with the values for A, B. C, 
and D substituted, which is used to determine a k+1 (0), that is the likelihood of being 
in state 0. The Four inputs to the Min* operation (that is A, B, C and D) are further 
defined in Figure 46B. The A term is equal to a k (0) plus 5 (0, 0, 0, 0), which is a 

20 metric corresponding to the generation of an output of 000 i.e., the metric value 
calculated by the metric calculator, plus the a priori likelihood that bit 1 equal to 0 
was received by the encoder plus the priori likelihood that bit 0 equal 0 was 
received by the encoder. Because all the values illustrated are in logarithmic scale 
adding the values together produces a multiplication of the likelihood. 

25 Similarly, B = a k (1) + 5 (1, 0, 1) + a priori (bit 1 = 1) + a priori (bit 0 = 0) 

Similarly C = a k (2) + 6 (1, 1, 0) + a priori (bit 1 = 1) + a priori (bit 0 = 1) 
Similarly D = a k (3) + 5 (0, 1 , 1) + a priori (bit 0 = 1) + a priori (bit 0 = 0). 
Figure 46B illustrates that prior to being able to perform a Min* operation on 
the four quantifies A, B, C and D several sub quantities must be added. For 

30 example, in order to obtain the value A to provide it to the Min* operations the 
values of a k (0) must be added to the metric value 5 (0, 0, 0) plus the a priori 
probability that bit 1 = 0 plus the a priori probability that bit 0 = 0. One way to add 
quantities is in a carry ripple adder as illustrated in Figure 47. 

Figure 47 is a graphical illustration of two methods of performing electronic 

35 addition. The first method of performing electronic addition is through the use of 
the carry ripple adder. A carry ripple adder has basically three inputs. Two inputs 
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1 for each bit to be added and a carry-in input In addition to the three inputs the 
carry ripple adder has two outputs, the sum output and a carry-out output. 
Traditionally the carry-out output is tied to the carry in input of the next successive 
stage. Because the carry-out output from one stage is coupled to the carry-in input 

5 of a second stage the carry must ripple through the adders in order to arrive at a 
correct result. Performing the calculation illustrated at 4709 using a ripple carry 
adder four stages of ripple carry adders must be employed. These stages are 
illustrated at 4701 , 4703, 4705 and 4707. It is obvious from the diagram that in 
order for a correct output to be achieved by a ripple carry adder a carry must ripple, 

10 or be propagated from the carry-out of ripple carry adder 4701 through ripple carry 
adder 4703, through ripple carry adder 4705 and finally into ripple carry adder 
4707. Because the carry rippies earlier stages must complete their computation 
before the later stages can receive a valid input for the carry in and thus compute a 
valid output. In contrast using the process of carry sum addition can speed the 

15 addition process considerably. So in order to perform the addition 4709, carry save 
addition is performed using the format at 471 1. Carry sum addition is a process 
known in the art. Carry ripple addition 4705 must have the final value ripple 
through 4 carry ripple adders in order to produce a valid result. In contrast with the 
carry sum adder, the computation of the sum and carry can be carried out 

20 simultaneously. Computation of the sum and carry equation will take only one 

delay period each. It should be obvious that a carry sum adder does not produce 
an output that is dependent on the numbers of digits being added because no 
ripple is generated. Only in the last stage of carry save add will a carry ripple effect 
be required. Therefore, the computation illustrated in Figure 46B may be speeded 

25 up through the substitution of a carry sum adder for a ripple carry type adder. 

Figure 48A is a block diagram in which a carry sum adder is added to a Min* 
circuit according to an embodiment of the invention. Figure 48A is essentially a 
copy of the circuit of Figure 46B with the addition of carry ripple adder 4801 and 
carry save adder 4803. The carry ripple adder 4801 performs a carry sum add on 

30 the likelihood that an a priori (bit 0 = 0), the likelihood that an a priori (bit 1=0) and 
the likelihood of the transition metric A (0,0,0). The inputs for carry ripple adder 
4801 may be added in carry sum adder 4803, however, since the inputs to the 
carry ripple adder are available earlier than the inputs to carry sum adder 4801 , 
they may be precomputed thereby increasing the speed of the overall circuit In 

35 addition, in Figure 48A the output of the Min* operation has been split into two 
outputs. 
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Figure 48B is a block diagram in which a carry sum adder is added to a Min* 
circuit according to an embodiment of the invention. In figure 48B register 4807 
has been added. Register 4807 holds the values of the adder until they are 
needed in the Min* block 4805. Since the inputs to adder 4801 re available before 
other inputs they can be combined to form a sum before the sum is needed thereby 
shortening the computation time over what would be the case if all the operands 
were combined only when they were all available. Register 4809 can hold values 
Ln_a k and Min_a k until they are needed. Carry look ahead adder 4803 is brought 
inside the Min* block. Carry look ahead Adder is the fastest form of addition 
known. In addition, in Figure 48B like figure 48A the output of the Min* operation 
has been split into two outputs. 

The splitting of the Min*output will be illustrated in successive drawings. To 
understand why the outputs of the Min* is split into two separate outputs it is 
necessary to consider a typical Min* type operation. Such a typical Min* operation 
is illustrated in Figure 49. Figure 49 is an implementation of the Min* operation. In 
Figure 49 two inputs 4901 and 4903 receive the values on which the Min* operation 
is to be performed. The values 4901 and 4903 are then subtracted in a subtracter 
4905. Typically such a subtracter will involve negating one of the inputs and adding 
it to the other input. The difference between the A and B input is then provided at 
output 4907. The difference value A is used in both portions of the Min* operation. 
That is the sign bit of A is used to select which of the inputs A or B is the minimum. 
This input is then selected in a circuit such as multiplexer 4909. Multiplexer 4909 is 
controlled by the sign bit of the A. The output of multiplexer 4909 is the minimum 
of A, B. In addition, the A is used in the log calculation of Ln(1+e- |A| ) The output of 
the log calculation block 4913 is then summed with the minimum of A and B and 
the resulting summation is the Min* of A, B. This operation too can be sped up by 
eliminating the adder 491 1 . Instead of making an addition in adder 4901 , the 
output of the log calculation block 4913, also designated as Ln_a k (0) and the 
output of multiplexer 4909 abbreviated as Min_a k (0). By eliminating the addition in 
491 1 the operation fo the Min* will be speeded up. The addition operation must 
still be performed elsewhere. The addition operation is performed within the Min* 
block 4805 in a carry save adder 4803 as illustrated in Figure 48A. 

With respect to Figure 49, although the output of the Min* operator, that is 
Ln _ak(0). i.e. 4915 and Min_a k (0), i.e. 4917 not combined until they are combined 
in adder 491 1 two outputs are combined in block 4911 and form the a k (0) values 
4913. The values 4913 represent the values that are pushed on to stack 4019. As 
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such, the operation 491 1 can be relatively slow since the a values are being 
pushed on a stack for later usage in any instance. In other words, the output of the 
Min* circuit of Figure 49 is calculated twice. The first instance is the output of the 
log block 4913 and the multiplexer block 4909 are maintained as integral outputs 
4915 and 4917. The integral outputs 4915 and 4917 are fed back to the input of 
the Min* where they are combined with other values that are being added. 

Figure 50A is a graphical illustration of a portion of two Min* circuits 
illustrated generally at 5001 and 5003. In the circuit of 5001 A and B are combined 
but it is assumed that B is larger than A and the value A will always be positive. In 
the second circuit it is assumed that the value of A will be larger than B and hence 
the A in circuit 5003 will always be positive. It is obvious that both assumptions 
cannot be correct. It is also obvious that one of the two assumptions must be 
correct. Accordingly, the circuit is duplicated and then a mechanism, which will be 
described later, is used to select the circuit that has made the correct assumption. 
Assuming both positive and negative values for A the process of computation of 
the log quantity of 5005 or 5007 can start when the first bit is produced by the 
subtraction of A and B. In other words, it is not necessary for the entire value to be 
computed in order to start the calculations in blocks 5005 and 5007. Of course, 
one of the calculations will be incorrect, and will have to be discarded. Once the 
least significant bit has been produced by the subtraction of A and B, the least 
significant bit of A can be placed in the calculation block 5005 or 5007 and the log 
calculation started. By not waiting until the entire A value has been produced, the 
process of computation can be further speeded up. 

Figure SOB is a graphical illustration of a portion of two Min* circuits 
illustrated generally at 5001 and 5003. It is a variation of the circuit of Figure 50A 
and either circuit may be used for the described computation. 

Once the value of A 5107 is computed, it can be used in the calculation in 
block 5113. In order to properly compute the value in block 51 1 3, the value of A 
needs to be examined. Since block 51 13 the computation takes longer than the 
process of operating the multiplexer 5009 with the sign bit of the 6 value of 5007. 
Since there is no way to determine a priori which value will be larger A or B, there is 
no way to know that the value of A will always be positive. However, although it is 
not known a priori which will be larger A or B duplicate circuits can be fabricated 
based on the assumption that A is larger than B and a second assumption that B is 
larger than A. Such a circuit is illustrated in Figure 50. 

3 values to be calculated in a similar fashion to the a value and all comments 



-71« 



WO 02/23738 



PCT/USO 1/28875 



1 with respect to speeding up a calculations pertain to p calculations. The speed of 
the a computation and the speed of the beta computation should be minimized so 
that neither calculation takes significantly longer than the other. In other words, all 
speed-up techniques that are applied to the calculation of a values may be applied 
5 to the calculation of beta values in the reverse direction. 

The calculation of the logarithmic portion of the Min* operation represents a 
complex calculation. The table of Figure 51A illustrates a look-up table 
implementation of the log function. Realizing a function by using a look-up table is 
one way of speeding a complex mathematical calculation. In the table it is seen 
10 that any value of delta larger than 1 .25 or smaller than 1 .25 will result in a log 

output equal to point 5. Therefore, instead of actually calculating the value of the 
logarithmic portion of the Min* the table of Figure 51 A can be used. The table of 
51A equivalents can be realized by logic equations 1 and 2. Equation 1 represents 
the positive A values of the table of 51 A and equation 2 representing the negative 
15 A values of table 51 A. 

Log-out = -log (A) + 0.5 = A(1) AND A(2) Equation 1 

Log-out = -log (-A) +. 0.5 = (A(0) AND A(1 )) NOR A(2) Equation 2 
Those skilled in the art will realize that any equivalent boolean expression will yield 
the same result, and that the lookup table may be equivalent^ replaced by logic 
20 implementing Equations 1 and 2 or their equivalents. 

Figure 51 A is a log table which contain look-up value for the calculation of 
the log portion of the Min* operation. The table of Figure 51 A also illustrates that 
the value of delta need only be known to the extent of its three least significant bits. 
Blocks 51 09 and 51 1 1 in Figure 51 represent the calculation of the logarithm of the 
25 minus delta value and the calculation logarithm of the plus delta value. The valid 
calculation, between 5109 and 5111, is selected by multiplexer 5115 and OR gate 
51 17. The output of log saturation circuit 51 13 is a 1 if all inputs are not equal to 
logic zero and all inputs are not equal to logic one. 

Multiplexer 5105 also is controlled by the value of delta as is multiplexer 
30 5115. Multiplexer 51 15 can be controlled by bit 3 of delta. (Any error caused by 
the selection of the wrong block 51 09 or 51 1 1 by using A bit 3 instead of A 9, the 
sign bit, is made up for in the log saturation block 51 13. How this works can be 
determined by consider Figure 51 B. 

Figure 51 B is a graphical illustration of a table used in the log saturation of 
35 Figure 51. In RANGE#2 and RANGE#4 where in_out is 0, A 3 selects the right 
range for in_out (i.e., when it's 0, it select log (+value) for in/out to be 0, and when 
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1 it's 1 it selects log (-value) for in_out to be 0). In RANGE#1 (i.e., +value), when A 3 
changes from 0 to 1, this would select incorrectly log(-value) for the mux output. 
However, the selected (mux) output is overwritten at the OR gate by the Log 
Saturation block. This Log Saturation block detects that A 8:3 is not all O's (e.g., it's 

5 000001) then it would force the in_out to be 1 which is the right value of RANGE#1 . 

Similarly, for RANGE#4 (i.e., -value), when A 3 changes from 1 to 0, it would 
select in correctly the log (+value) for the mux output. However, the selected (mux) 
output is overwritten at the OR gate by the Log Saturation block. This Log 
Saturation block detects that A 8:3 is not all 1 's (e.g., it's 111110) when it would 

10 force the in/out to be 1 which is the right value for RANGE #4. The sign bit of A 

controls whether A or B is selected be passed through the output. The input to the 
A and B adders 5101 and 5103 are the same as that shown in Figure 48A. A and 
B form sums separately so that the correct sum may be selected by multiplexer 
5105. In contrast the carry sum adder 5107 can accept all the inputs to A and B in 

15 order to calculate A. Of course, one of the inputs must be in two's compliment form 
so that the subtraction of A minus B can be accomplished. In other words, either 
the A or B values can be negated and two's complimented and then add to the 
other values in order to form the A value. The negating of a value is a simple one 
gate operation. Additionally, the forming of a two's compliment by adding one is 

20 relatively simple because in the carry sum addition first stage is assumed to have a 
carry of zero. By assuming that that carry is equal to one instead of a zero a two's 
complimentary value can be easily formed. 

Figure 52A is a graphical illustration and circuit diagram indicating a way in 
which a values within the SISO may be normalized. As the a values within the 

25 SISOs tend to converge the values in the registers patrol the a values have a 

tendency to grow between iterations. In order to keep the operation fo the SISO as 
economical as possible in terms of speed and memory usage, the value stored in 
the a register should be kept as small as only needed for the calculations to be 
performed. One method of doing this is the process called normalization. The 

30 process of normalization in the present embodiment occurs when the high order bit 
of the value in all the a registers is a 1 . This condition indicates that the most 
significant bit in each a register is set. Once the condition where all of the most 
significant bits in all of the a registers are set then ail of the most significant bits can 
be reset on the next cycle in order to subtract a constant value from each of the 

35 values within the a registers. Such a process can be done using subtraction of 

course, but that would involve substantially more delay and hardware. The process 
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1 illustrated in Figure 52 involves only one logic gate being inserted into the timing 
critical path of the circuit. Once the all most significant a bits condition is detected 
by AND gate 5201 multiplexer 5203 can be activated. Multiplexer 5203 may be 
implemented as a logic gate, for example, an AND gate. Bits B 0 through B 8 are 

5 provided to the a 0 register. Either B 9 or a zero is provided to the a 0 register 
depending on the output of AND gate 5201. Accordingly, only 1 gate delay is 
added by normalizing the a values. In such a manner a constant value can be 
subtracted from each of the a registers without increasing any cycle time of the 
overall decoder circuit. 

10 Figure 52B is a graphical illustration and circuit diagram indicating an 

alternate way in which a values within the SISO may be normalized. The circuit is 
similar to that illustrated in Figure 52A. The multiplexor 5203 selects only bit 9 (the 
most significant bit, as a being passed through or being normalized to 0. 
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WHAT IS CLAIMED IS: 

1 . A method for encoding an information signal the method comprising: 
nonsystematically encoding the information signal; 

interleaving the information signal to form an interleaved information 

signal; and 

encoding the interleaved information signal. 

2. The method as in claim 1 wherein encoding the interleaved information 
signal further comprises nonsystematically encoding the interleaved information 
signal. 

3. The method as in claim 2 wherein the encoding further comprises 
convolutionady encoding. 

4. The method as in claim 1 where nonsystematically encoding further 
comprises recursively encoding. 

5. The method as in claim 1 wherein the interleaving comprises even-odd 
interleaving. 

6. The method as in claim 1 wherein the interleaving comprises bit 
interleaving. 

7. The method as in claim 5 further comprising: 

selecting an odd encoding from the encoded information signal; 
selecting an even encoding from the encoded interleaved information 

signal; and 

concatenating the selected odd encoding to the selected even 
encoding to form a composite signal. 

8. The method as in claim 5 further comprising: 

selecting an even encoding from the encoded information signal; 
selecting an odd encoding from the encoded interleaved information 

signal; and 

concatenating the selected odd encoding to the selected even 
encoding to form a composite signal. 
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1 9. The method as in claim 7 further comprising mapping the composite 

signal in a signal mapper. 

10. The method as in claim 8 further comprising mapping the composite 
5 signal in a signal mapper. 

11. A method for encoding an information signal comprising: 
encoding the information signal; 

interleaving the information signal to form an interleaved information 

10 signal; and 

nonsystematically encoding the interleaved information signal. 

12. The method as in claim 11 wherein encoding the interleaved 
information signal further comprises nonsystematically encoding the interleaved 

15 information signal. 

13. The method as in claim 12 wherein encoding further comprises 
convolutionally encoding. 

20 14. The method as in claim 11 where nonsystematically encoding further 

comprises recursively encoding. 

1 5. The method as in claim 1 1 wherein the interleaving comprises even- 
odd interleaving. 

25 

16. The method as in claim 11 wherein the interleaving comprises bit 
interleaving. 

17. The method as in claim 15 further comprising: 

30 selecting an odd encoding from the encoded information signal; 

selecting an even encoding from the encoded interleaved information 

signal; and 

concatenating the selected odd encoding to the selected even 
encoding to form a composite signal. 

35 

18. The method as in claim 14 further comprising: 
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selecting an even encoding from the encoded information signal; and 
selecting an odd encoding from the encoded interleaved information 

signal; and 

concatenating the selected odd encoding to the selected even 
encoding to form a composite signal. 

1 9. A method for encoding an information signal comprising: 
encoding the information signal; 

modulo-N interleaving the information signal, where N is an integer 
greater than one; and 

encoding the modulo interleaved information signal. 

20. The method as in claim 19 wherein encoding the interleaved 
information signal further comprises nonsystematically encoding the interleaved 
information signal. 

21 . The method as in claim 19 wherein encoding the interleaved 
information signal further comprises nonsystematically encoding the interleaved 
information signal. 

22. The method as in claim 1 9 further comprising: 

selecting alternately between the encoded information signal and the 
interleaved information signal ; and 

accepting the selected encoding in a mapper. 

23. The method as in claim 19 wherein the encoding further comprises 
recursively encoding. 

24. The method as in claim 19 wherein the encoding further comprises 
convolutionally encoding. 

25. The method as in claim 19 wherein the interleaving comprises bit 
interleaving. 

26. The method as in claim 19 further comprising: 

selecting a first encoding from the encoded information signal; and 
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selecting N-1 encodings from the modulo-N encoded interleaved 
information signal; and 

accepting the selected encoding in a mapper. 

27. The method as in claim 19 wherein the interleaving further comprises 
srandom interleaving. 

28. The method as in claim 19 wherein the interleaving further comprises 
random interleaving. 

29. The method as in claim 1 9 wherein the interleaving further comprises 
block interleaving. 

30. A method for parallel concatenated encoding an information signal, the 
method comprising: 

turbo trellis encoding an information signal; and 
mapping the encoded information signal in a first mapper; and 
concatenating the encoded signal mapped in the first mapper with 
another signal mapped in a second mapper. 

31. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises nonsystematically encoding the information signal in a constituent 
encoder. 

32. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises recursively encoding the information signal in a constituent 
encoder. 

33. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises convolutionally encoding the information signal in a constituent 
encoder. 

34. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises even-odd interleaving the information signal in an even-odd 
interleaver. 
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35. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises modulo-N interleaving, where N is greater than 2, the information 
signal in a modulo-N interleaver. 

36. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises ST even/odd interleaving the information signal in an even/odd 
interleaver. 

37. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises ST modulo-N interleaving, where N is greater than 2, the 
information signal in a modulo-N interleaver. 

38. The method as in 30 wherein the turbo trellis encoding an information 
signal comprises interleaving the information signal before providing it to a 
constituent encoder. 

39. The method as in claim 38 wherein the interleaving comprises modulo 
interleaving. 

40. The method as in claim 38 wherein the interleaving comprises ST 
interleaving. 

41 . The method as in 30 wherein concatenating the encoded signal 
mapped in the first mapper with another signal mapped in a second mapper 
comprises: 

puncturing a portion of the encoded information signal; and 
mapping the punctured portion of the information signal concatenated 
with a portion of the information signal in a second mapper. 

42. The method as in 30 wherein concatenating the encoded signal 
mapped in the first mapper with another signal mapped in a second mapper 
comprises: 

puncturing a portion of the encoded information signal; and 
mapping a portion of the* information signal in a second mapper. 

43. A method for interleaving a first block of data tuples to create a 
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1 second block of data tuples, the method comprising: 

identifying a modulo sequence designation for each data tuple in the 
first block; and 

interleaving the data tuples from the first block into positions in the 
5 second block having the same modulo sequence designation. 

44. The method of claim 43 wherein the bits of each data tuple from the 
first block are interleaved independently into positions in the second block. 

10 45. The method of claim 44 wherein the bits of each data tuple from the 

first block are interleaved into tuples in the second block having the same position 
of significance within the tuple. 

46. A method for encoding data tuples comprising: 

15 ST interleaving the data tuples in a first even-odd interleaver; 

encoding in a first encoder the data tuples interleaved in the first 

interleaver; 

ST interleaving the data tuples in a second even-odd interleaver; 
encoding in a second encoder the data tuples interleaved in the 
20 second interleaver; and 

selecting encoded tuples alternatively from the first and second 

encoder. 

47. The method as in claim 46 wherein the encoding in a first encoder 
25 further comprises nonsystematically encoding in a first encoder. 

48. "The method as in claim 46 wherein the encoding in a second encoder 
further comprises nonsystematically encoding in a second encoder. 

30 49. A method for encoding data tuples, the method comprising: 

encoding the data tuples in a first encoder; 
interleaving the data tuples in an even/odd interleaver; 
encoding the interleaved tuples in a second encoder; and 
selecting encoded tuples alternatively from the first and second 

35 encoder. 
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50. The method as in claim 49 wherein the encoding in a first encoder 
further comprises nonsystematically encoding in a first encoder. 

51 . The method as in claim 49 wherein the encoding in a second encoder 
further comprises nonsystematically encoding in a second encoder. 

52. The method as in claim 49 wherein the interleaving comprises ST 
interleaving. 

53. The method as in claim 49 further comprising mapping the alternatively 
selected tuples in a mapper. 

54. A method of encoding data symbols the method comprising 
dividing a data tuple into a sequential sequence of equally sized tuples 

of N input bits, the tuples being of size N regardless of the size of the data tuple: 
and 

turbo trellis modulated encoding the equally sized tuples. 

55. The method as in claim 54 wherein turbo trellis modulated encoding 
the tuples further comprises: 

modulo interleaving the tuples; 

encoding the modulo interleaved tuples; and 

modulo selecting the encoded tuples. 

56. A method for producing a code from a sequence of tuples the method 
comprising: 

encoding the sequence of tuples in a first encoding; 
modulo interleaving the input tuples in at least one interleaving; 
encoding the modulo interleaved tuples in at least one encoding; 
selecting the encoded tuples sequentially from each encoding; and 
mapping the selected tuples in at least one mapper. 

57. The method as in claim 56 wherein encoding the sequence of tuples in 
a first encoder comprises systematically encoding the sequence of tuples in a first 
encoding. 
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58. The method as in claim 56 wherein encoding the sequence of tuples in 
a first encoder comprises nonsystematically encoding the sequence of tuples in a 
first encoding. 

59. The method as in claim 56 wherein encoding the sequence of tuples in 
a first encoding comprises convolutionally encoding the sequence of tuples in a first 
encoding. 

60. The method as in claim 56 wherein encoding the sequence of tuples in 
a first encoding comprises recursively encoding the sequence of tuples in a first 
encoding. 

61 . The method as in claim 56 wherein modulo interleaving the input 
tuples in at least one interleaving comprises ST interleaving. 

62. The method as in claim 56 wherein encoding the modulo interleaved 
tuples in at least one encoding comprises systematically encoding the sequence of 
N tuples. 

63. The method as in claim 56 wherein encoding the modulo interleaved 
tuples in at least one encoding comprises nonsystematically encoding. 

64. The method as in claim 56 wherein encoding the modulo interleaved 
tuples in at least one encoding comprises convolutionally encoding. 

65. The method as in claim 56 wherein encoding the modulo interleaved 
tuples in at least one encoding comprises recursively encoding. 

66. The method as in claim 56 wherein selecting the encoded tuples 
sequentially from each encoding comprises puncturing at least one bit from an 
encoding. 

67. The method as in claim 66 wherein the puncturing at least one bit from 
an encoding further comprises substituting at least one uncoded bit for the at least 
one bit punctured from the encoding. 
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1 68. A method for creating a parallel concatenated code having a higher 

rate than the constituent encodings the method comprising: 
TTCM encoding information tuples; 

mapping a first portion of the encoded information tuples in a first 

5 mapping; 

puncturing a second portion of the encoded tuples and substituting 
uncoded tuples; 

mapping the uncoded tuples in a second mapping. 

10 69. A method for selecting mappings in a TTCM encoder the method 

comprising: 

selecting non-Ungerboeck mappings; 

computing the average effective distance between code words in each 
mapping; and 

15 selecting the non-Ungerboeck mapping which has approximately the 

greatest effective distance between code words. 

70. A method for generating a modulo-N interleaving sequence the method 
comprising: 

20 selecting a range of addresses from 0 to M for a seed interleaving 

sequence; 

creating N interleaving sequences from the seed sequence; 

creating a first sequence by selecting elements sequentially from the 
N interleaving sequences; 
25 multiplying each element in the first sequence by N to create a second 

sequence; 

adding the element position modulo-N to each element in the second 
sequence to generate the modulo-N interleaving sequence. 

30 71. The method as in claim 70 herein an interleaving sequence is created 

from the seed sequence by using the inverse sequence of the seed sequence. 

72. The method as in claim 70 wherein an interleaving sequence is created 
from the seed sequence by using the time reversal of the seed sequence. 

35 

73. The method as in claim 70 wherein an interleaving sequence is created 
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from the seed sequence by using the inverse of the time reversal of the seed 
sequence. 

74. A method for communicating data the method comprising: 
modulo-N turbo-encoding the data; 

communicating the data across a channel; and 
modulo-N decoding the data. 

75. The method as in claim 74 wherein modulo-N turbo-encoding the data 
comprises modulo-N turbo-trellis encoding the data. 

76. The method as in claim 74 wherein modulo-N turbo-encoding the data 
comprises: 

interleaving the data N+1 times; and 

encoding the data N+1 times in constituent encoders. 

77. The method as in claim 74 wherein modulo-N turbo-encoding the data 
comprises: 

interleaving the data N times; and 

encoding the data N+1 times in constituent encoders. 

78. The method as in claim 76 herein interleaving comprises ST 
interleaving. 

79. The method as in claim 77 wherein interleaving comprises ST 
interleaving. 

80. The method as in claim 74 wherein modulo-N decoding the data 
comprises modulo-N parallel decoding the data. 

81 . A method for creating a higher rate code from a lower rate encoder 
constituent encoder, the method comprising: 

turbo trellis code modulation modulo-N encoding an input sequence of 
tuples to produce an output sequence of tuples; and 

puncturing the output sequence and substituting uncoded input 
sequence tuples for corresponding encoded output sequence tuples. 
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82. The method as in claim 81 wherein the turbo-trellis coded modulation 
modulo-N encoding comprises ST encoding. 

83. The method as in claim 81 wherein the turbo-trellis coded modulation 
modulo-N encoding comprises interleaving the input sequence in N modulo-N 
interleaves and encoding the resulting N interleaved sequence in N encoders. 

84. A method for selecting a constellation mapping for a Turbo-Trellis 
Encoder. 

selecting non-Ungerboeck mappings; 

determining the effective minimum distance of code words in the non- 
Ungerboeck mappings; and 

selecting the non-Ungerboeck mapping having code words with the 
largest effective average distance form each other; 

85. A method of encoding data tuples the method comprising: 
encoding the data tuples with a Reed-Solomon; and 

turbo trellis encoding the tuples encoded with the Reed-Solomon code. 

86. The method as in claim 85 wherein turbo trellis encoding the tuples 
further comprises turbo trellis modulo-N encoding the tuples. 

87. The method as in claim 86 wherein turbo trellis encoding the tuples 
comprises ST interleaving the tuples. 

88. The method as in claim 86 wherein turbo trellis encoding the tuples 
comprises ST interleaving the tuples prior to providing them to any constituent 
encoder. 

89. An apparatus for encoding an information signal the apparatus 
comprising: 

a nonsystematic encoder that accepts an information signal; 
an interleaver that interleaves the information signal to form an 
interleaved information signal; and 

an encoder that encodes the interleaved information signal. 
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1 90. The apparatus of claim 89 wherein the encoder that encodes the 

interleaved information signal is a nonsystematic encoder. 

91 . The apparatus of claim 89 wherein the encoder further comprises a 
5 convolutional encoder. 

92. The apparatus of claim 89 where nonsystematic encoder further 
comprises a recursive encoder. 

10 93. The apparatus of claim 89 where the interleaver comprises an even- 

odd interieaver. 

94. The apparatus of claim 89 where the interleaver comprises a bit 
interleaver. 

15 

95. The apparatus of claim 93 further comprising: 

a selector that selects an odd encoding from the encoded information 
signal, and an even encoding from the encoded interleaved information signal; and 
means for concatenating the selected odd encoding to the selected 
20 even encoding to form a composite signal. 

96. The apparatus of claim 95 further comprising a signal mapper that 
accepts the composite signal. 

25 97. An apparatus for encoding an information signal the apparatus 

comprising: 

an encoder that encodes the information signal; 

an interleaver that interleaves the information signal to form an 
interleaved information signal; and 
30 a nonsystematic encoder that encodes the interleaved information 

signal. 

98. The apparatus of claim 98 wherein the nonsystematic encoder 
comprises a convolutional encoder. 

35 

99. The apparatus of claim 98 wherein the nonsystematic encoder 
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comprises a recursive encoder. 

1 00. The apparatus of claim 98 wherein interleaver comprises an odd-even 
interleaver. 

101 . The apparatus of claim 98 wherein interleaver comprises a bit 
interleaver. 

1 02. The apparatus of claiml 00 further wherein the modulo N interleaver is 
an even odd interleaver. 

103. An apparatus for encoding an information signal the apparatus 
comprising: 

an encoder that encodes the information signal; 

a modulo-N interleaver that encodes the information signal, where N is 

an integer greater than one; and 

an encoder that encodes the modulo interleaved information signal. 

1 04. The apparatus of claim 1 03 wherein the encoder that encodes the 
interleaved information signal further comprises a nonsystematic encoder. 

1 05. The apparatus of claim 1 03 wherein the encoder that encodes the 
interleaved information signal further comprises a nonsystematic encoder. 

106. The apparatus of claim 103 further comprising: 

a selector that alternately selects between the encoded information 
signal and the interleaved information signal and provides the result as a 
concatenated signal; and 

a mapper that accepts the concatenated signal and performs a 

mapping on it. 

1 07. The apparatus of claim 1 03 wherein the encoder comprises a recursive 
encoder. 

1 08. The apparatus of claim 1 03 wherein the wherein the encoder 
comprises a convolutional encoder. 
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1 1 09. The apparatus of claim 1 03 wherein the wherein the interleaver 

comprises a bit interleaver. 

110. The apparatus of claim 103 further comprising: 
5 a selector that selects a first encoding from the encoded information 

signal; and selects N-1 encodings from the modulo-N encoded interleaved 
information signal; and 

a mapper that accepts selected encodings from the selector. 

10 111. The apparatus of claim 1 03 wherein the interleaver further comprises a 

srandom interleaver. 

1 1 2. The apparatus of claim 1 03 wherein the interleaver further comprises a 
random interleaver. 

15 

1 1 3. The apparatus of claim 1 03 wherein the interleaver further comprises a 
block interleaver. 

1 14. An apparatus for parallel concatenated encoding an information signal, 
20 the method comprising: 

a turbo trellis encoder that encodes an information signal; 
a first mapper that accepts the encoded information signal; 
a second mapper that accepts the encoded information signal; 
a selector that selects a first signal mapped in the first mapper and 
25 selects a second signal mapped in the second mapper; and 

means for concatenating the encoded signal mapped in the first 
mapper with the signal mapped in a second mapper. 

115. The apparatus as in 1 14 wherein the turbo trellis encoder comprises at 
30 least one nonsystematic constituent encoder. 

116. The apparatus as in 1 14 wherein the turbo trellis encoder comprises at 
least one recursive constituent encoder. 

35 117. The apparatus as in 1 14 wherein the turbo trellis encoder comprises at 

least one convolutional constituent encoder. 
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118. The apparatus as in 1 14 wherein the turbo trellis encoder includes an 
even-odd interleaves 

1 19. The apparatus as in 114 wherein the turbo trellis encoder includes a 
modulo-N interleaver where N is greater than 2. 

120. The apparatus as in 1 14 wherein the turbo trellis encoder includes an 
ST even/odd interleaver. 

121 . The apparatus as in 1 14 wherein the turbo trellis encoder includes an 
ST modulo-N interleaver where N is greater than 2. 

122. The apparatus as in 1 14 wherein the turbo trellis encoder includes an 
interleaver prior to each constituent encoder. 

123. The apparatus as in 122 wherein the interleaver comprises a modulo 
interleaver. 

124. The apparatus as in 122 wherein the interleaver comprises a modulo st 
interleaver. 

125. The apparatus as in 122 wherein means for concatenating the 
encoded signal mapped in the first mapper with the signal mapped in a second 
mapper comprises: 

means for puncturing a portion of the encoded information signal; and 
a second mapper for mapping the punctured portion of the information 
signal concatenated with a portion of the information signal. 

126. The apparatus of 1 14 wherein means for concatenating the encoded 
signal mapped in the first mapper with the signal mapped in a second mapper 
further comprises means for puncturing a portion of the encoded information signal; 
and 

means for mapping a portion of the information signal in a second 

mapper. 

127. An apparatus for interleaving a first block of data tuples to create a 
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second block of data tuples, the apparatus comprising: 

means for identifying a modulo sequence designation for each data 
tuple in the first block; and 

means for interleaving the data tuples from the first block into positions 
in the second block having the same modulo sequence designation. 

128. An apparatus for encoding data tuples the apparatus comprising: 

an ST even-odd interleaver that accepts the data tuples to be encoded; 
an encoder that encodes tuples output from the ST even-odd 

interleaver; 

a second ST even-odd interleaver that accepts the data tuples to be 

encoded; 

a second encoder that encodes tuples output from the ST even-odd 
interleaver; and 

a selector that selects encoded tuples alternatively from the first and 
second encoder. 

129. The apparatus of claim 128 wherein the first encoder comprises a 
nonsystematic encoder. 

1 30. The apparatus of claim 129 wherein the second encoder comprises a 
nonsystematic encoder. 

131. An apparatus for encoding data tuples, the apparatus comprising: 
a first encoder that encodes the data tuples; 

an odd-even interleaver that interleaves the data tuples; 
a second encoder that encodes the interleaved tuples; and 
a selector that selects encoded tuples alternatively from the first and 
second encoders thereby providing a composite signal. 

1 32. The apparatus of claim 1 31 wherein the first encoder further comprises 
a nonsystematic encoder. 

1 33. The apparatus of claim 1 31 wherein the second encoder further 
comprises a nonsystematic encoder. 
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1 1 34. The apparatus of claim 1 31 wherein the interleaver comprises an ST 

interleaves 

1 35. The apparatus of claim 131 further comprising a mapper that maps the 
5 composite signal. 

1 36. An apparatus for encoding data tuples the apparatus comprising 

a divider that divides the data tuples into a sequential sequence of 
equally sized tuples of N input bits, the tuples being of size IM regardless of the size 
10 of the data tuple: and 

a turbo trellis modulator that encodes the equally sized tuples. 

1 37. The apparatus as in claim 1 36 wherein turbo trellis modulator further 
comprises: 

15 at least one modulo interleaver that interleaves equally sized tuples; 

at least two encoders, at least on of which accepts interleaved tuples 

and 

a modulo selector that selects encoded tuples from at least two 

encoders. 

20 

1 38. An apparatus that produces a code from a sequence of tuples the 
apparatus comprising: 

a first encoder that encodes the sequence of tuples in a first encoding; 

at least one modulo interleaver that interleaves the input tuples in at 
25 least one interleaving; 

at least one second encoder that encodes the modulo interleaved 
tuples in* at least one encoding; 

a selector that selects encoded tuples sequentially from each 
encoding; and 

30 at least one mapper that maps the selected tuples. 

1 39. The apparatus as in claim 1 38 wherein the first encoder comprises a 
systematic encoder. 

35 140. The apparatus as in claim 138 wherein the first encoder comprises a 

nonsystematic encoder. 
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141 . The apparatus as in claim 138 wherein encoding the sequence of 
tuples in a first encoding comprises convolutionally encoding the sequence of 
tuples in a first encoding. 

142. The apparatus as in claim 138 wherein the first encoder is a recursive 
encoder. 

143. The apparatus as in claim 138 wherein the at least one modulo 
interleaver comprises at least one modulo ST interleaving. 

144. The apparatus as in claim 138 wherein encoding the modulo 
interleaved tuples in at least one encoding comprises systematically encoding the 
sequence of N tuples. 

145. The apparatus as in claim 138 wherein the at least one second 
encoder comprises a nonsystematic encoder. 

146. The apparatus as in claim 138 wherein the at least one second 
encoder comprises a convolution^ encoder. 

147. The apparatus as in claim 138 wherein the at least one second 
encoder comprises a recursive encoder. 

148. The apparatus as in claim 138 wherein a selector that selects encoded 
tuples sequentially from each encoding further comprises puncturing means for 
puncturing at least one bit from an encoding. 

149. The apparatus as in claim 148A wherein the puncturing means further 
comprises means for substituting at least one uncoded bit for the at least one bit 
punctured from the encoding. 

150. An apparatus that creates a parallel concatenated code having a 
higher rate than the constituent encodings the apparatus comprising: 

a TTCM encoder that accepts information tuples; 
a mapper that maps a first portion of the encoded information tuples in 
a first mapping; 
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puncturing means for puncturing a second portion of the encoded 
tuples and substituting uncoded tuples; 

mapper that maps the uncoded tuples in a second mapping. 

151. An apparatus for communicating data the method comprising: 

a modulo-N turbo-encoder that accepts the data to be communicated 
and produces encoded data to be communicated ; 

means for communicating the encoded data to be communicated 
across a channel; and 

a modulo-N decoder that accepts and decodes the encoded data 
received from the channel. 

152. The apparatus of claim 151 wherein modulo-N turbo-encoder 
comprises a modulo-N turbo-trellis encoder. 

153. The apparatus of claim 151 wherein the modulo-N turbo-encoder 
comprises: 

N+1 interleaves that interleave data to be communicated; and 
N+1 times constituent encoders that encode the data interleaved by 
the N+1 interleaves. 

1 54. The apparatus of claim 1 51 wherein the modulo-N turbo-encoder 
comprises: 

N interleavers that interleave the data to be transmitted thereby 
forming N interleaved versions of the data ; and 

N+1 constituent encoders that encode the data to be transmitted and 
the interleaved versions of the data. 

1 55. The apparatus of claim 1 53 wherein the N interleavers comprises ST 
interleavers. 

156. The apparatus of claim 154 wherein the N interleavers comprises ST 
interleavers. 

157. The apparatus as in claim 151 wherein the modulo-N decoder 
comprises a modulo-N parallel decoder. 
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1 58. An apparatus for creating a higher rate code from a lower rate encoder 
constituent encoder, the apparatus comprising: 

a turbo trellis code modulation modulo-N encoder that accepts an input 
sequence of tuples and produces an output sequence of tuples; and 

means for puncturing the output sequence and substituting uncoded 
input sequence tuples for corresponding encoded output sequence tuples. 

1 59. The apparatus as in claim 158 wherein the turbo-trellis coded 
modulation modulo-N encoder further comprises an ST encoder. 

160. The apparatus method as in claim 158 wherein the turbo-trellis coded 
modulation modulo-N encoder further comprises N modulo-N interleaves that 
interleave the input sequence into interleaved sequences; and 

N encoders that encode the resulting interleaved sequences. 

161. An encoder that encodes data tuples the encoder comprising: 
a Reed-Solomon encoder that encodes the data tuples; and 

a turbo trellis encoder that accepts the tuples encoded with the Reed- 
Solomon encoder. 

162. The apparatus as in claim 161 wherein the turbo trellis encoder further 
comprises a turbo trellis modulo-N encoder. 

163 . The apparatus as in claim 162 wherein turbo trellis encoder further 
comprises an ST interleaver. 

164 . The apparatus as in claim 162 wherein turbo trellis encoder comprises 
ST interleaves that interleaves data tuples prior to providing them to any 
constituent encoder. 
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